OOCOHEHT BESOHE 



BD 090 207 



40 



SP 007 942 



AOTHOB 
TITLE 

IHSTITDTIOII 
SPONS AGEHCY 

FOB DATE 

.GRANT 

NOTE 

EDBS PRICE 
DESCRIPTORS 



Aoelnan, Howard S. 

Facilitating Educational Change and Preparing Change 
Agents. 

California Oniv., Riverside, 

Bureau of Education for the Handicapped (DHEH/OE) , 
Washington, D,C, Div, of Training Prograns, 
Aug 73 

OEG-0-71-m52(603) 

122p,; For related document, see SP 007 950 

HF-$0.75 HC-$5,aO PLOS POSTAGE 

4tchange Agents; Education; ^Educational Change; 

Professional Training; Special Education 



ABSTRACT 

This document is a tvo«part monograph included in a 
series that presents concepts and practices reflecting an analysis of 
programs^ to prepare general and special education personnel. The 
first section of this monograph, entitled "The Development and 
Diffusion of 'Hainstreaming * Approaches," disciiisses procedures for 
developing, disseminating, installing, and maiaitaining prototype 
mainstreaming approaches. An examination of these procedures includes 
a discussion of a) four developmental steps, b) factors which must be 
dealt with in planning strategies for institutional change, c) a 
proposal for facilitating national diffusion, and d) an example of a 
local diffusion strategy using master or specialist teachers as 
change agents. The second section of this monograph is entitled "The 
Preparation of Change Agents Who Can Diffuse "Mainstreaming* 
Approaches." Its purpose is to describe the pilot program implemented 
to prepare change agents and to discuss the implications derived from 
these findings that have relevance for future preparation of such 
personnel. Topics discussed are the selection of participants, 
program rationale, instructional content and process, and program 
evaluation, (PD) 
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Preface 



Thi; doctnnent you are about to read was prepared as part of a Special 
Project funded by the Division of Training, REH., USOE, This preface (1) 
describes the general frame of reference frooi which we approach the 
concerns of special education, (2) sui^arizes the major products 
produced as part of the Special Project activity, and (3) acknowledges 
those dedicated persons without whom the project could not have been 
undertaken. 

A General Frame of Reference ^ 
It is unfortunate that special educators continue to deal with major 
topics, such as classroom instruction and personnel preparation, as if 
these topics were unique to special education or a specific category of 
exceptionality. A major effort needs to be made to avoid contributing 
further to the erroneous ingress ion that the concerns of general and 
special education (and of the various areas of special education) are 
mutually exclusive and/ or substantively different. This Impression is 
not only false, but leads to the harmful impression that general and 
special educators (and various groups of special educators and other 
^ professionals) have little to contribute to each other. 

It seemfi reasonable to suggest that, in reality, the concerns of 

^Some of the discussion which follows also appears in an article by the 
author entitled""The relationship between general and special education," 
( Academic Therapy > 1972, VII, 323-326). 
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special education are best viewed within the framework of a conceptualiza- 
tion of the basic concerns confronting the American system of formal 
education. Figure A represents my attempt to sumnarize these basic 
concerns and the relationship between general and special education with 
reference to these concerns. Broadly and practically stated, the basi': 
programmatic concerns are: 

1) What should be the role (nature and scope) of formal 
education in America today and what changes should be 
considered for the future? 

2) What and how should we teach? 

3) What types of personnel (roles and functions) are 
necessary for accomplishing the desired goals of 
formal education? . 

\ 

4) How can we best recruit, educate, and retain the 
high level of personnel necessary for ensuring high 
quality education? 

It seems clear that these questions are so closely interwoven that 
the manner in which any one is answered has profound implications for 
the othersj, e.g., the role one establishes for the schools provides Che 
basis for determining the instructional content and process which, in 
turn, should clarify the personnel required and their training needs. 
And, of course, any position taken with regard to these questions 
raises the concern over evaluation , i.e., what and how to describe and 
judge the positions which have been and currently are being postulated 
as answers to education's basic concerns. 

Finally, with reference to the relationship between general and 
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special education, it is felt that the major issues and problems encom- 
passed by the above-stated concerns are substantively the same for both 
sub- fields of education* However, since an answer formulated for the 
majority population may require modifications (additions and/or cxcep- 
tio^.s) when applied to exceptional individuals , special education is 
confronted with the additional concern of clarifying rationally and 
empirically such modifications. 

From a conceptual viewpoint, then, it seems reasonable to suggest 
that the systematic resolution of the basic concerns confronting the 
education system (see Figure A) requires, first, formulation of answers 
with reference to the general population and, second, clarification of 
the modifications required with reference to all and/or specific groups 
of exceptional individuals* In practice, of course, such a systematic 
approach is not always feasible* Thus^ special educators of^xn find it 
necessary to work in an area of concern where major issues and problems 
have been resolved for the general population in ways which special 
educators view as unacceptable or where answers singly are nonexistent* 
In such instances, whether or not it is explicitly understood and stated, 
special educators are forced to deal wi">h issues and problems which are 
common to both general and special education^ and therefore, the answers 
formulated have application for both the majority population and 
exceptional individuals* That is to say, such answers will necessarily 

^The term concern is used to delineate a broad area of focus; the term 
issue is used to delineate a sub-area over which there is theoretical 
and/or procedural disagreement; and the term problem is used to delineate 
a sub-area over which there is no disagreement, but there is difficulty 
in formulating an appropriate solution. 
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be either modified versions of answers which have direct application to 
the general population or they will be directly applicable as formulated. 

(Unfortunately> the application of such answers to the general 
population often Is not made because the special educator has not 
discussed his work*s relationship to general education. It Is for this 
reason that many of special education's potential contributions to 
general education are lost. Equally as unfortunate Is the waste which 
accrues from the failure of special educators to build upon the founda- 
tion laid by their colleagues In general education. With regard to a 
wide variety of questions related to the education of exceptional 
Individuals, It Is not uncommon for special educators to approach such 
concerns [Issues and problems] as If the questions raised were new and 
unique, rather than simply being specialized versions of more basic 
questions which have long confronted general education. As a result, 
special educators too often needlessly redo work previously accon^lished 
by general educators, both groups initiate parallel activities, and, in 
general, progress in both sub-fields of education is hindered. 
[Analogous implications, of course, could be discussed with reference 
to the interrelationships between the various categories of exceptionality.]) 

The preceding views should clarify for the reader the orientation 
with which I approach such questions as: 

1) What is the nature of the heterogeneity which exists 

in such populations of pupils currently categorized as learning 
disabled, emotionally disturbed, educationally handicapped, 
disadvantaged, and so forth, and what are the implications 
of this heterogeneity for service, training, and research? 



2) 



What and how should we teach these pupils? 



3) 



Do we need specialist teachers? 



4) 



Hdw should we educate personnel to ensure high quality 



classroom programs which meet the needs of such pupils? 



5) 



How should we evaluate the educational programs which serve 



such pupils and the programs which prepare the needed 



professionals? 



Products 



In the various written products resulting from project activity, 
some ideas and experiences are shared which have a bearing on these and 
other related matters. What is presented is neither rooted solely in 
special education nor intended only for special educators. The concepts 
and practices reflect an analysis of general and special education 
classroom and personnel preparation programs; the implications which 
are suggested are for regular and special classroom instruction and 
regular and special personnel preparation programs. It is, indeed, my 
hope that the various products will have some heuristic value for any 
reader and for the field at large. These products aro: 

I. Competency- Based Training in Education; a conceptual view — This 
monograph presents a conceptual model of the major phases and tasks 
involv^^d in planning, implementing, and evaluating personnel preparation 
programs in the field of education. Specifically, seven phases are 
discussed: (1) the formulation of the program rationale, (2) curricular 
planning, (3) evaluational planning, (4) administrative planning, 
(5) instructional planning, (6) program implementation, (7) program 
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evaluation. Key references are provided to resources which have relevance 
for. each phase. Also discussed are: the view that competency-based 
training is an iiiq>ortant but insufficient orientation to personnel 
preparation, and some ideas related to the development and diffusion of 
prototype models. Included in the appendices are: references for 
con^etency-based and other r^ated personnel preparation program 
models, a representation of the sequence of major tasks involved in 
planning, implementing, and evaluating a school system program, a table 
describing sources of information and materials, and brief discussions 
of three important topics related to personnel preparation- -"Recruiting 
and Maintaining Education Professionals," "Some Specific Implications 
for the Preparation of Teachers," and "Criteria for Admission to 
Preparation Programs and Accredited Professional Standing." 

II. Facilitating Educational Change and Preparing Change Agents -- 
This monograph is divided into two parts. The first part, entitled "The 
Development and Diffusion of * Mains treaming' Approaches," Is devoted to 
a discussion of procedures by which prototype mainstreaming approaches 
might be developed, disseminated, installed, and maintained. More 
specifically, (1) four major developmental steps are discussed, (2) 
factors which must be dealt with in planning strategies for institu- 
tional change are identified, (3) a proposal for facilitating national 
diffusion is suggested, and (4) an example of a local diffusion 
strategy using master or specialist teachers as change agents is 
described. 

The second part of this monograph is entitled "The Preparation of 
Change Agents Who Can Diffuse 'Mainstreaming' Approaches." The dual 
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purpose of this section is (I) to describe the pilot program we Implemented 
to prepare change agents and (2) to discuss the Implications derived 
from our experiences and findings which have relevance for the future 
preparation of such personnel, Top.'^.cs discussed are the selection of 
participants, program rationale, instructional content and process, and 
program evaluation. 

III. Learning Problems and Classroom Instruction — This monograph 
presents our orientation to the topic of youngsters with learning/behavior 
problems and to the question regarding what teachers should do with such 
youngsters. The primary emphasis is on conceptualizing the classroom 
needs of groups assigned labels such as learning disabled, emotionally 
disturbed, educationally handicapped, aud culturally disadvantaged. The 
conceptualization which evolves is based on the view that each of these 
categories encompasses an extremely heterogeneous group of youngsters-- 
ranging from those who do have major disorders-deficits which Interfere 
with their learning to those whose learning and behavioral problems stem 
primarily from thci deficiencies of the school system. This view of the 
heterogeneity which exists within such exceptional children groupings 
leads us to suggest some very specific implications for diagnosis, 
remediation, and prevention, and these implications, in turn, lead to 
a discussion of implications for teacher education and accountability. 

Mori specifically, par^ 1 ("Learning Problems Revisited") encompasses 
in the initxi;! chapter, a description of four youngsters with learning 
problems. This is followed by a general discussion of the heterogeneity 
which exists in the learning disabled, emotionally disturbed, educa- 
tionally handicapped, and disadvantaged populations (Chapter 2), and a 
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general conceptualization o£ the processes of learning and teaching and 
their relatlonahip to successful and unsuccessful classroom instruction 
(Chapter 3). In part 2 ("Remedial Classroom Instruction^'), building on 
the concepts evolved in part 1, It is suggested that teacheis can 
Identify and attempt to meet the remedial needs of pupils with learning 
problems by employing a set of sequential and hierarchical teaching 
Strategies. A general exposition of the two step process which is 
Involved is presented in Chapter 4 and is elaborated upon, conceptually 
and practically, in Chapters 5*8. Finally, with a view to the need for 
accountability in education, the process of evaluation is conceptualized 
and some ideas are offered for evaluating school programs (Chapter 9). 
Also included in the appendices are discussions of key variables related 
to educational programs, problems related to early intervention efforts, 
motivation and the classroom, and instructional procedures (a generic 
view). 

IV. Resource Guide; Instructional Planning ^-This resource guide 
was prepared as a coinpanion work to the monograph entitled Competency * 
Based Training in Education; a conceptual view (cited above). It is 
intended primarily for those actually engaged in the tasks of instruc- 
tional and curricular planning, but it should also be useful to those 
who wish to learn more about such planning t Specifically, the guide 
includes: I. annotated references to some key general references which 
provide an orientation to curricular and instructional planning; II. a 
guide to some specific resources on curricular and instructional planning; 
III. an outline of sources of information and materials; IV. discussions 
of curricular and instructional planning, including several supplementary 
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"handouts" designed as instructional aids. 

V. Resource Guide: Evaluational Planning ^'-This resource guide 
contains annotated references to relevant literature and other sources 
of information. It was prepared as a companion work to the monograph 
entitled Competency^- Based Training in Education: a conceptual view 
(cited above). Described are a variety of resources which can be used by 
(a) evaluation novices who want to. pursue a program of self-education 
and (b) persons with a fair degree of understanding regarding evaluation, 
but who want to expand their knowledge regarding the process of evalua- 
tion and the resources which are available for use in teaching about, 
planning for, or carrying out program evaluation. The annotated 
references in this document are divided into the following parts: 
I. some key general discussions relevant to program evaluation; II. 
specialized discussions and practical aids focusing specifically on 
(a) methodology and design, (b) teacher effectiveness, and (c) handbooks 
and guides; III. discussions of techniques and instruments including 
(a) generic discussions, and (b) catalogues and reviews; IV. general 
resources for finding infonaation relevant to evaluation. Also included 
are two appendices: (A) some thoughts and aids on evaluational planning; 
and (B) procedures being developed for evaluation of the experimental 
program undertaken as a part of our special project activity. 
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Introductory Note 



The problem of insltutlonali^lng appropriate and substantive 
changes in schools is as intriguing as it is complex. So many special 
programs designed to improve the instruction of pupils (e.g., in such 
areas as math, English, reading, science) and of teachers (pre- and 
in-service) have not resulted in the far reaching or dramatic changes 
which have been anticipated. While the lack of dramatic Impact can be 
attributed to a variety of factors, at the heart of the matter is the 
fact that so little is known about the comprehensive diffusion 
(dissemination, installation, and maintenance) of Innovations in 
education. However, this is not to say we know nothing about the 
process and problem of change. As Havelock and Havelock state: "There 
is a significas^t body of knowledge and theory which can form the basis 
of coherent models of training in change process.**^ 

In this monograph, I attempt to focus on the topic of facilitating 
educational change and discuss our efforts td prepare change agent 
personnel. The experiences, ideas, conceptions, hypotheses, and practical 



R.G. Havelock and M. C. Havelock, Training for Change Agents . Ann Arbor: 
Center for Research on Utilization of Scientific Knowledge, Institute for 
Social Research, University of Michigan, 1973. In this excellent 
resource, the authors discuss four models of change, i.e., change as 
(a) a problem-solving process, (b) a research-development-and-dif fusion 
process, (c) a process of social interaction, (d) a linkage process. 
(These four models are not mutually exclusive.) Additional material 
from this book is presented in this monograph in Appendices A and C. 
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suggestions which are presented have evolved over years of service, 
training, and research activity and undoubtedly will undergo revision as 
a result of the ongoing activities in which I and my colleagues are 
engaged. 
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The Development and Diffusion of "Mainstreaming'' Approaches 

If the majority of youngsters who manifest learning problems are 
to be satisfactorily served in regular classrooms (i.e., '*mains t reamed" ) , 
some major changes will need to be made with reference to regular class- 
room instruction in this country. It is not my purpose here to explore 
the nature of such changes;^ rather, the intent is to discuss the problem 
of institutionalizing whatever changes en^lrically are found to be 
indicated. There is a particular focus on how master and i?.peclalist 
teachers can be effective change agents with reference to the diffusion 
(dissemination, installation, and maintenance) of prototype "mainstream* 
ing" programs. 

As Sarason (1971) has pointed out: 

Good Ideas and Missionary zeal are sometimes enough 
to change the thinking and actions of individuals; they 
are rarely^ if ever, effective in changing conqjlicated 
organizations (like the school) with traditions, dynamics, 
and goals of their own. [p. 213J 

If this is the case, and I think most evidence indicates that it is, it 
is unfortunate that we seem to be more concerned with "spreading the 
word" regarding mainstreaming approaches than ve are with the compre - 
hensive diffusion of such approaches* Still, this tendency is under- 
standable since we know a good deal more about ballyhooing an idea than 



^Elsewhere (Adelman, 1973) I have suggested some of the changes I and 
my colleagues are involved in investigating. 
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we know about the process by which comprehensive and widespread institu- 
tional change can be accomplished. 

In order to understand what is involved in such a process, it is 
necessary to rely on the reported experiences and thinking of others 
(e.g., Lippitt, Watson, and Westley, 1958; Carson, Gallaher, Miles, 
Pellegrin, and Rogers, 1962; 1965; Bennis, 1966; Clark and Cuba, 1965; 
Cuba, 1968; Bennis, Benne, and Chin, 1969; Sarason, 1971; Rogers and 

Shoemaker, 1971; Baldridge, 1972; Havelock, 1973; Havelock and Havelock, 
2 

1973) and on one's own empirical and conceptual efforts. The following 
is a discussion of procedures by which prototype mainstreaming programs 
might be developed, disseminated, installed, and maintained. I start 
with the ascomption that validated prototypes of mainstreaming programs 
need to be developed and spread and that various interest groups (e.g., 

governmental bodies, educators, private organizations) want to facilitate 

3 

such development and diffusion. 



Developing a Feasible Prototype 

As a basic premise, let us accept the idea that it is preferable to 



The reader who wants to pursue the topic of planned change beyond the 
references cited above can begin with two annotated bibliographies; L.M. 
Maguire, S. Tcmkin, and CP. Cummings, An annotated bibliography on ad * 
ministration for change , 1971. Research for Better Schools, Inc., 1700 
Market St., Suite 1700, Philadelphia, Penna, 19103; E.A. Can^jbell, M. C. 
Havelock, R.G. Havelock, J.C. Huber, and S. Zimmerman, "Major works on 
change in education, an annotated bibliography" (Appendix C in R.G. 
Havelock, The change agent's guide to innovation in education ). Engle- 
wood Cliffs: Educational Technology Publications, 1973. 

^Clark and Cuba (1965; also see Cuba, 1968) discuss the theory-practice 
continuum as involving four phases or stages, i.e., research, develop- 
ment, diffusion, and adoption. For purposes of this paper, I include 
research under development and adoption under diffusion. 
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base all program development on as solid a research foundation :^.3 is 
feasible. Given such a research base, the development of workable 
prototype models can be viewed as involving four major steps: (1) the 
formulation of generic and specific conceptualizations, (2) analysis of 
the needs related to translating specific conceptualizations Into prac- 
tical demonstrations, (3] generic and specific tooling up activity in 
preparation for practical demonstrations, (4) the actual implementation 
and evaluation of practical demonstrations. 

More specifically, the first step in developing a prototype program 
Involves the formulation of a general conceptual view of systematic 
efforts to mainstream youngsters with learning problems. Such a generic 
conceptualization attempts to clarify major ideas, concerns. Issues, and 
problems Involved in such an approach to educating youngsters with 
learning problems. From this general framework, a number of specific 
program models might be conceptualized. 

Once a specific prototype is formulated, an analysis can be made of 
what is needed in order to translate the idea into a practical demonstra- 
tion, i.e., what is needed in terms of materials, personnel, facilities, 
and so forth, and, of course, what all this means in ter^ of dollars. 
It should be en^haslzed that the purpose of such feasibility studies 
is not to find which approach is the least expensive. Rather, the 
intent simply is to describe needs and costs. Judgement as to whether 
it is feasible to proc^eed with a given approach is based on buch consi- 
derations as whether the pertinent decision-makers are attracted to the 
prototype and whether the necessary resources are available for a 
practici^l demonstration and for its viiffusion if it is effective. 
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It also should be noted that feasibility studies usually point both to 
generic and program specific needs. For example, all the prototypes will 
need to be evaluated and much of the evaluation activity should be 
identical. At the same time, a particular approach may encompass speci- 
fic instructional objectives which other approaches do not, and, there- 
fore, some idiosyncratic curricular and evaluative procedures may be needed. 

As a consequence of such circumstances, tooling up activity may 
involve both generic and program specific activity. In meeting generic 
needs, the products of the tooling up activity potentially should be use- 
ful for all programs, e.g., generic curricular and evaluational packages. 
Since the resources needed to develop such products probably are beyond 
those available to any one pro^^ram, major support for such activity is 
required from the public and private sectors. If such generic tooling 
up activity is accomplished, it can be anticipated that the activity 
required to tool up for a specific program will be reduced greatly. 

The final step in the development of feasible prototypes is the 
implementation and evaluation of the demonstration programs. This step 
involves: (1) the initiation, on-going assessment, modification, and 
on-going management of instructional and non-curr icular activities and 
(2) the description and judgement of the program's antecedents, trans- 
actions, and outcomes.'^ Given that the demonstration is judged to be 
successful and worth spreading, the nt>!Xt concern is with its diffusion. 



Alt should be emphasized that evaluation is done at each step of the 
process as should be evident from the fact that judgements are made as 
to whether or not to proceed. The evaluative concern at this fourth 
step is with the need to validate the prototype as implemented, i.e., 
to demonstrate it is effective, albeit under experimental as contrasted 
with vork-a-day conditions. 
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Diffusion of Prototype Models 

The term diffusion as used here is meant to connote the process by 
which a prototype model not only Is heard about (disseminated), but is 
installed and maintained in other situations where It is needed. Since 
so little is known about how to accomplish this process with reference 
to school programs, the following is offered for whatever heuristic 
value it may have. 

Based on the pertinent literature and relevant personal experiences, 
it seems reasonable to suggest that any proposed strategy for instltu^ 
tlonal change must provide at least for the following if an appropriate 
climate and context for change is to be created: 

1) appropriate incentives for change (e.g., rewards, expectations 
of success, intrinsically valued outcomes), 

2) the presentation of an appropriate range of relevant alternatives 
for change so that an institution may select one which is workable 
within the Institution's context and Is acceptable to those who will 
carry It out, 

3) establishment of mechanisms (e^g. , special training, resources, 
rewards, procedures designed to Improve organizational health) ^o facil- 
itate the effective functioning of any person who takes or Is given 
responsibility for Installing changes,^ 



5Such facllltatlve mechanisms may be directed at change agents an4/or 
at persons who are to change. For example, the change agent may need 
special training regarding how to facilitate a particular change; at the 
sue time, persons who are to change may need training to develop pre* 
requisite knowledge, skills, and attitudes before they can be expected 
to carry out a particular change. Examples of other mechanisms which 
may be needed are: released time, extra-clerical help. In situ demon- 
strations, cooBunlcatlon oriented meetings, frequent Indications of 
support for a given change by the organisation's Leaders, *'lnf luentlals," 
O and gatekeepers, and by relevant professional associations. 
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4) any person who performs the role of change agent by behaving more 
as a pragmatic than as a "Utopic" advocate (Gallaher, i.965),^ 

3) appropriate structuring of the scopve and timing of change (e.g., 
planned transition or phasing in of changes), 

6) appropriate feedback regarding progre&^s of change activity, 

7) ongoing, supportive mechanisms to maintain substantive changes as 
long as they remain appropriate.^ 

Awareness of these needs^ has led me to suggest some procedures both for 
national and local diffusion efforts. 



^Gallaher (1965) states that there \fi '*a large body of research to support 
the basic assumptions underlying the^r^gmatic model, that is that people 
will more readily accept innovations that they can understand and perceive 
as relevant, and secondly, that they have had a hand in planning" (pp. 41- 
4?.)* Other attributes of effective change agents are described in 
Appendix A. 

^Havelock and Havelock (1973), in reviewing the model of change which 
conceptualizes change as a linkage process, list the following six 
propositions which have been derived from this model: (1) "To be truly 
helpful and useful, resource persons must be able to simulate the user's 
problem solving processes.'* (2) "To derive help from resource persons 
(and resource systems) the user must be able to simulate resource system 
processes , e.g., to appreciate research knowladge, he must understand 
how research knowledge is generated and validated." (3) "Effective 
utilization requires reciprocal feedback ." (4) " Resource systems need 
to develop reciprocal and collaborative relationships not only with a 
variety of potential users but also with a large diverse group of other 
resource systems." (5) " Users need to develop reciprocal and collabora * 
tive relations with a variety of resource systems (cosmopoliteness)." 
(6)" A willingness to listen to new ideas (openness) is an important 
prerequisite to change. This applies both to resource persons and users." 

^Another way to think about the characteristics of a change process is 
in terms of the inhibiting factors which must be overcome. Miller (1967) 
suggests (a) three general inhibiting f actors-^traditionalism, laziness, 
and fear and insecurity, and (b) seven (less general) educational factors 
inhibiting change--rut of experience, administrative reticence, educa- 
tional bureaucracy, insufficient finances, community indifference and 
resistance, inadequate knowledge about the process of change, and 
inadequate teacher education programs. 
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A Proposal for Facilitating Diffusion on a National Scale * While the 
usual forms of dissemination (e.g., reports, journal articles, monographs) 
have their uses, for purposes of diffusion a more systematic and 
enticing approach seems indicated. Thus, it in recommended that each 
validated prototype be described in a federal or state agency "Request 
for Proposal" (RFP) which offers program development grants. In this 
way, those who are interested in developing new programs or revamping 
existing programs could receive support if they are willing to install 
a given model. The initial funding could be for regional installation 
of a particular prototype. For example, if there are 3 validated proto- 
types to be disseminated, all three could be installed in a given region. 
This would make bi demonstration of each prototype available in each 
region of the country. (It is recognized that a prototype may have to 
be adapted to meet the specific needs of a particular region.) 

In selecting which applicants to fund for the development of these 
regional demonstrations, it would seem to be important to choose from 
among those whc document (a) a v>eed for and the capability of developing 
such a program (given the grant funds) and (b) a commitment, resource 
base« and mechanism for carrying on after the development grant funding 
ends. It is assumed that to facilitate an applicant's efforts to install 
and maintain the program (1) the original prototype (or at least its 
personnel) will be available for purposes of consultation (training, 
demonstrations, and so forth with reference to planning, implementing, 
and evaluating such a program); and (2) other support mechanisms will be 
accessible (e.g., technical support). 

For these assunqjtions to be viable, it will be necessary to provide 
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some continuing grant funds to the original prototype programs (at least 
for consultation activity), and it would be important to facilitate the 
establishment of an ongoing, accessible, and comprehensive network of 
other program support mechanisms. Such additional support mechanisms 
should be designed to meet the developmental and maintenance needs of 
adopted/adapted prototypes. Included in such a network would be infor- 

Q 

mation and material exchanges, technical support, and so forth. Parti- 
cipants In such a network could come from both the public and private 
sectors. 

Once the regional demonstrations are implemented, program development 
grant RFP's could be issued again. At this point, selected applicants 
would be able to learn the installation process at the nearest regional 
demonstration program. 

With the installation of prototype programs at an increasing number 
of sites, the problem of maintenance becomes more critical. The network 
of support mechanisms mentioned above, of course, would be a very impor- 
tant aid. As another way of facilitatiug program maintenance, it would 
be desirable for programs to establish direct mechanisms for inter- 
program cooperation. (Since we know so little about such mechanisms, 
there is a need to stimulate the development of models for such program 
cooperative functioning. ) 

Fiaally, it would be important to evaluate the entire diffusion 
enterprise. Such evaluation is necessary not only so that we can 

^One example of such support activity is the Technical Assistance 
Development System (TADS Project) funded by the Bureau of Education for 
the Handicapped. 
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improve the efficiency and effectiveness of diffusion activity with 
reference to a specific prototype, but so that we may learn more about 
Che general proce»ss of institutional change. 

An Example of Local Diffusion Using Master or Specialist Teachers as 
Change Agents . As has been suggested in a preceding section of this 
paper, a key to the success of diffusion efforts will be the person(s) 
who takes or is given responsibility for installing changes* Such a 
resource person has been called a change agent (e.g., see Havelock, 
1973).^^ At this point , it seems appropriate to describe an approach 
where teacher-personnel were used to install a prototype mainstreaming 
approach in several demonstration classrooms, and how they facilitated 
the spread of this program to other classrooms and schools. 

For the past few years, my colleagues and I have been experimenting 
with the use of school-personnel (e.g., successful specialist and master 
teachers) who are freed from regular responsibilities so that they can 
help the district Implement changes which have a positive impact on 
"problem*' pupils in both regular and special class settings. The 
primary function of these change agents is in the area of in-service 
teacher education. However, the author believes such efforts have an 

^Elsewhere, I have discussed the resource concept , emphasizing that one 
of the various functions encompassed by such a concept is that of facil- 
itating planned change (Adelman, 1972). Havelock (1973) states that a 
change agent can act as: (1) a catalyst, (2) a solution giver, (3) a 
process helper, and/or (4) a resource linker. Focusing on the process 
helper role, he suggests that a "change agent's activity can be concep- 
tualized into 6 stages. These are: I. Building Relationships, II. Di- 
agnosis (From Pains to Problems to Objectives), III. Acquiring Relevant 
Resources, IV. Choosing the Solution, V. Gaining Acceptance j« VI. Stabi- 
lizing the Innovation and Generating Self-Renewal. 
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important impact on other resource functions (see Adelman, 1972). For 
instance, their success in improving the performance of other teachers 
results in fewer "problem" pupils and, therefore, in less need for 
supplementary assessment and instruction. In adr^ition, in performing 
the in-service function,, they are expected to be advocates of the rights 
and needs of "problem" pupils and to provide advice regarding policies 
affecting such pupils. Finally, as secondary functions, when and only 
when it is appropriate, they provide aid in the development of new 
policies and practices, help find and provide materials, do supplement 
tary assessment, and participate in research activity. 

Basically, what these change agents do is to go from classroom to 
classroom (in some instances, one person goes; in others, a team of two 
is sent) to help other teachers learn moer effective procedures for 
coping with children with learning and behavior problems. If a suffi- 
cient number of specialists are available, they can be used to train all 
the teachers in a given district who desire and/or need such in-service 
education. If the number of the change agents is limited, the model 
can be varied so that they work with a limited number of teachers 
(approximately three in any given school); these teachers are then used 
for demonstration and training to achieve the diffusion objectives. 



HAs will become evident, this approach to the diffusion of mains treaming 
approaches has a number of built-in incentives for teachers, e.g., the 
training does not cost the teacher any money, and it is offered in their 
own classrooms during the regular school day. In addition, it should be 
noted that only a few teachers in a school can be taught at one time, and 
this "limited enrollment" feature seems to have an enticing effect. (The 
first teachers chosen are volunteers, i.e., they have expressed a desire 
to learn more effective procedures for coping with children with learning/ 
behavior problems. ) 
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This "spread-of-ef feet'' approach employs a slightly modified version 
of the basic process-model. 

^ic^re specifically, the process which has evolved consists of four 
overlapping steps and requires from 4 to 7 weeks per cycle, during which 
time a change agent can rotate among three teachers and provide a 
reasonably comprehensive program to Improve teacher and pupil perfor- 
mance. The four steps are: 

1) Demonstration and discussion (2-3 weeks). The training cycle is 

initiated with an individual meeting between the change agent and each 

of the three participating teachers who are to be trained during that 

cycle. A major focus of the discussion is on learning what procedures 

each teacher currently employs in coping with learning and behavior 

problems, and on sharing some general thoughts about such children. 

(The specifics of the training process are described to prospective 

participants prior to their selection for the in-service program but are 

usually reviewed at this time as well.) Then, for a day or two, the 

change agent observes during the reading period in each of the three 
13 

classrooms. The reading period is chosen as a point of focus because 



12These meetings provide an important opportunity for the change agent to 
begin to build an effective working relationship with the participating 
teachers. Havelock (1973) suggests nine characteristics of such a rela- 
tionship that "comprise an ideal base from which to launch an innovative 
process," i.e., reciprocity, openness (with 6 openness dimensions 
enumerated), realistic expectations, expectations of reward, structure, 
equal power, minimum threat, confrontation of differences, and involve- 
ment of all relevant parties. 

^^The three participating teachers must schedule their reading periods 
for different times of the day to allow the change agent to rotate to 
each room. During the initial discussion and observation periods, prelim- 
inary assessment is made by the change agent (s) of the strengths, weak- 
nesses, and limitations which may be encountered in effecting appropriate 
change. 
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this is the time when learning and behavior problems frequently occur 
and because of the importance of this basic skill. Based on these 
initial discussions and observations, the change agent assumes responsi- 
bility for teaching during the reading period. She provides a "master" 
demonstration of the procedures which the participating teacher is to 
learn, and it frees the teacher to observe what is being demonstrated. 
Before and after such demonstrations, the change agent meets with the 
teacher to discuss the rationale underlying the demonstrated proce- 
dures, to explore alternative ideas and procedures, introduce relevant 
resources, and to problem solve when a procedure is not effective. 
(If a team of two change agents are present, one of them might carry 
on some of the interchange with the teacher while the other is demon- 
strating the program.) In short, during this step the participating 
teacher observes a master demonstration and takes part in in-depth, 
personalized discussions of what she has observed, all in her own 
classroom, with her own students, every day for approximately 2 weeks. 
In addition, during this step the change agent usually reconmends a 
concise, relevant set of readings. 

2) Practice (i-2 weeks). After approximately 2 weeks of demonstra- 
tion and discussion (sooner if the teacher appears ready), the partici- 
pating teacher begins to apply what has been learned. While the change 
agent continues to be responsible for teaching the reading lesson, the 
teacher "practices" new procedures. During this step the change agent 
observes the teacher's practice whenever feasible and is ready to 
provide guidance, feedback, and additional demonstrations. Clearly, 
then. Steps 1 and 2 overlap; this blending of one step into the next is 
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ii^>ort«nt Mt each traniitlon point in the process. 

3) Initial Implementstion (1*2 veeks). After « period of supervised 
participation, the teacher assusaet full responsibility tor teaching the 
reading lesson using the new procedures as she has adapted then, vhile 
the chaagc agent observes* Meetings vith the teacher are held as needed 
for feedback, questions and ansvers, and general discussion, and if 
necessary, the change agent provides addltiorial detnonst rat ions. (Af. 
t'jl* point, t > process--vhich we call a comprehensive apprenticeship 
Model**resefRbles traditional supervised teaching, but by virtue of th« 
preceding Interactions, the experience is very different, e.g., because 
of the close collaborative relationship vhlch has been developed, the 
contacf;8 between the -^supervisor" and the "supervised*' usually are 
devoted to mutual sharing and problem solving rather than to critiques.) 

4) Follov'up. Obviously, the change agent should be available as often 
as possible to answer questions, solve problems, ^tc. Thus, as she 
begins a new training cycle (with teachers in the same school or in 
another scl^ool) it is necessary tc reserve some time for fv>11ov*up 
consultation, i.e., observation and feedback, deimonst rat ions and dis* 
cussion. (In practice, it has been found th*t such support is needed 

mostly in the first inonth after cosapleting the third step, and that this 

14 

can be dealt with by setting aalde 1 day a week for such consultation.) 



l^Havelock (1973) states: *'T!he key work in insui^ing continuance is 
* internallgation . * Uhere possible, the change agent should lead the 
client toward self-help and responsibility in the malntenacTice of the 
innovation. 'Riere are st least six iiif>ortant coa^^iderations in 
insuring continuance. These *re : 1. continuing \reward, 2. practice and 
routinizatlon, 3. structural integration into the svsten, A. continuing 
evaluation^ 3. providing for continuing maintenance, 6. continuing adap* 
tation cafp*blllty.'^ 
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In thcfi* ♦c'-ools iZ-^rrr thf chjnf* vcrk with cnW j frv t#*ch#r^ 

with it virv to d^vi^Iopinf d€!Nion« t r a t i or rooms «nd utilising 4 *'iprrad-of- 
<;I.<1" to ^fct>7iir4J»h th« diffusion ' 1r c t i vr * , t hr chjnirr .ff#'nt 
wrfciK with arv^tHrr "*ncHor" mcwNpr of Ihc »chr,uil stjff, - g . , * reading 
tpeciali»t or «n adwlni it rttor . This aiK^vor person learns to act at a 
facilitator (o«i»tltc change agent; by participating In the process, i.e., 
observing, practicing, discussing, observing, and so forth* Then, sfter 
the change agent Moves on to begin a nev training cyc^e at another 
school, it is the ar«chor indlvidvjai wt^o facilitates the on-site diffusion 
nf the progrJtts to other teachers in thr $choo3 (w^n? *re r^leM^md on a 
scheduled basis to observe in tSe deiM^na t rat ion rooms). 7>iis facilitator 
«tqp]o)fS « WLdified version of the four -step process described abcrve. 
That IS, the f»rilitator acco«f>anies other teachers in the school to 
h€€ J drmons t ra t ion hy the change agent and provides the discussion 
si'tvifjed in Step 1, for the subsequent ttcips, t h.^ facilitator foes 
tn the 'learners'" classrooms to collaborate as needed dsiriiiii the 
practice, 1 n i t i a 1 • aim^ J rnenta t i on, «nd follav*up steps. 



^ ^Aa the above fxaiffple dew>ns t r at es » the change agent - teacher can plav an 
impcTtanl and <^niq\>e role in Kelpinf school districts upgrade thie t >inpe- 
tency of regul ar 'C lassroon teachers with regaid to the education of 
pupils With learni :%g/ behavior problesis. (>n another level, such change 
a^ent^ also could be esaploytd in progrus designed to prepare change 
agents ar^ personnel. for Instance, a state departmenf of educataon 
could cmpjov <for a limited period of t line- -perhaps 2 Near si pairs of 
char^-e agents \f^k<>/y would be available, on request, to local school 
districts for to 7 weeks of consv^ 1 1 a t ion (payment to go to the state 
to dc'fray the xost of the cor^^s) to help (a) initiate appropriate 
programs for the ''special** population of pupils to be served, and (t) 
develop* the needed personnel amJ/or verify the ccjwpetency oi the 
district's specialists. (With reference to accreditation, such a tew 
could help insure that all change agents and specialists in th« state are 
able to ferforM at least at a ainl^l level of cotqpetence in order to be 
cert if ied. ) 
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In connection with the ahove procedures, at is i ntrres t i to n<^te 
thst in hl9 boo> t The Oun^e A^ent ' b Gi^iide iolnnovjuion in Mucstion , 
Rsvelock (1973 ^ s\jm4rifes six resesrch- i<dent i f t ed phases In the process 
of indlvidasl adoption cf an innovation* These are: avareness, interest, 
evaluation, trial, adoption, and integration. He then indicate* that the 
change agent's activities thou id be oes joined lo c c»^^t oi r>Avr with th^s-c 
siK phases, i.e., be designed so that the change agent is with (not 
ahead tr behind) the individual adopter. T^t^s, he suj^gests the process 
occurs in the follovmiei way (see Havelock, i'i>73, p 115): 



( x>or d i yia t i an^e Aj^e n t Ac tlvlties with the Clirnt*s Adopt lOfi Activities 




Help, server 



Cl lent 



Awareness 



2 . Interest : 

1 n fonts t i '^n seeding 

*3 . Evaluation 



4. Trial, test 



5 AidL>p t 2 on 
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In our Initial studies, the four steps descri^e<? above have beer, 
found to be a proniainn approach to the diffusion of nuinst reaming 
procedures. Hot only does th€ f»odel allow change agents to coordinate 
their activities to the client's adoption activities as described by 
Kavelock ( 1973)9 it also allows the change agent to i8inif&l2e group- 
based pressures to resist innovation. 

In concluding, I hasten to indicate that I i^cognite that such a 
systematic approach to development and diffusion requires a considerable 
inve$trai«?nt of t iiae and money. Liiiportant programs rarely evolve rapidly 
or cheaply, the space progrm which has taken us to the moon and beyotvd 
IS i& case in point. Appropriate costs and time schedules, even when 
they are extensive, are not and should not bf discussed as issues . The 
enlv issue is what priority we want to pl^^.e on in^ roving the education 
of <'ur nstion's youth. 
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'Hte Preparation of Oiange Agents Vho Can Diffuse 
'*Hainst reaming** Approaches 

Durinji the first Year of a special project designed to develop a 
conpetency-based training model, my colleagues and 1 prepared five 
teachers to assume change agent roles through a Master's degree progrmm. 
We had hoped to progress fast enough durl^i^g :he year so that ve would 
have a well-defined curriculum and some relevant evaluation procedures 
which could be validated during the second year of the project. Fr^inkly 
speaking, this rapidly proved to be a naive hope. (While unfortunate, 
this circumstance did not prevent us fron achieving our major goal 
which was to evolve a generic model to facilitate the development of 
systematic programs for personnel preparation in educat lon--see 
Adelman, 1973a.) The dual purpose of this paper is (a) to describe the 
programs we implemented to prepare the change agents and (b) to discuss 
the implications derived from ou: experiences and findings which have 
relevance for the future preparation of such personnel. 



The Pilot Program 
No effort is made here to exhaustively describe the program. The 
intention is to convey ^ aenae of our initial approach to planning, 
implementing, and evaluating the program, to relate certain practical 
faceta which may be of general interest, and, more importantly, to lay 
soae foundation for the discussion of Implications for future programs 
which is preaented in the next aection of the paper. 
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Selection of Participants 

f^jB soon as we knew that ve would be able to offer an exper Imtental 
preparation program to prepare change agent personnel y ve contacted 
the superintendent of the local school district. His interest and 
positive support was an Important aid in recruitment.^ He sent a 
letter to all qualified teachers in the district describing the experi- 
mental Master *s degree program and Indicating that a year's leave of 
absence would be granted to those who applied and were selected. He 
also set up a district screening coninittee to facilitate selection of a 
rank-ordered pool of qualified applicants, e.g. » those who district 
personnel had judged to be effective teachers and to be effective in 
interpersonal interactions with fellov teachers and administrators. From 

this poolt the top applicants of those who could meet the university 

2 

graduate admission requirements were selected. The six program parti- 
cipants (all fep^ale) originally selected ranged in age from 24 to 49 

3 

and in teaching experience from 1 to 8 years. 



^At this writings the superintendent is still attempting to find enough 
funds so that the district can develop an experimental program using 
the personnel we have prepared in the capacity of district-wide change 
agents . 

^The School of Education's GRE criteria score levels were waived. 

^Early in the year» it became evident that one of the participants 
was having difficulty with the program. A variety of efforts were made 
to help her, but it soon became mutually evident that she would probably 
be unable to successfully complete the program, and she transferred to 
a program which may be more suitable for her. (In exploring why our 
selection procedure had failed, we discovered th^t her principal had been 
away at the time the district personnel director was screening appli- 
cants for our program. Since the principal was unavailable, the screen- 
ing was based on the limited information available in her files. We 
have learned since that the principal would not have recomKnended her.) 
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ProRram Rationale 

The Master's degree level personnel enrolled in this program were 
trained to assume change agent roles in school districts, particularly 
with reference to providing better educational opportunities for pupils 
with learning and behavior problems. In this connection, the program 
empha&Aized knowledge, skills, and attitude"^ related to assessment* 
program planning and implementaticn, consultation, supervision, and 
research, and prepared personnel who are equipped not only to provide 
direct services for pupils, but who also are able to function as pre- 
and in-service educators, and as intelligent consumers of and partici- 
pants in research. By the time they completed the program, each parti- 
cipant had demonstrated via actual performance in the public schools 
and in written and oral evaluation sessions that she had acquired at 
least the minimal level of ccmpetencc necessary for on the job success, 
as judged by the professorial and supervisory staff. 

The program yaat guided by a set of propositions and long range 
goals which emphasize the need to prepare individuals who are not only 
cechnically competent, but who are effective members of society and of a 
profession which has a unique role to play in that society. The content 
of the program was conceptualized in terms of the areas of instructional 
focus and level of competence needed to perform this unique professional 
role, rather than courses, units, and hours. The process employed in 
developing the needed competence involved coordinated and integrated 
academic, observational ^ and participatory experiences, with special 
emphasis on utilizing a comprehensive apprenticeship-like model whenever 
it was appropriate and feasible and on accommodating individual differences 
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amoiig program participants. 

It was our Intention that the professionals we trained would have a 
significant impact on improving the educational opportunities of a wide 
range of youngsters, including those with learning or behavior problems 
or both. We take the position that a given youngster's success or 
failure in school is a function of the interaction between his strengths, 
weaknesses, and limitations and the specific classroom situational factors 
he encounters. With regard to youngsters who manifest school learning/ 
behavior problems, in California such pupils are often categorized as 
educationally handicapped (elsewhere such pupils are labeled as learning 
disabled or emotionally disturbed). The program participants also were 
concerned with so-called disadvantaged pupils. Our view of the pupil 
populations categorized as learning disabled, emotionally disturbed, 
educationally handicapped and disadvantaged is that each consists of 
three major subgroups of youngsters with learning problems. These 
subgroups include at one end of a continuum those youngsters who 
actually have major disorders/deficits interfering with learning and 
at the other end of the continuum those whose problem stems primarily 
from the deficiencies of the learning environment; the third group 
encompasses those youngsters with minor disorders/deficits who, under 
appropriate circumstances are able to compensate for such handicaps. To 
meet the instructional needs of the youngsters in each of these three 
subgroups, the trainees learned sequential and hierarchical teaching 
strategies which may be used in both regular and special classroom 
instructional programs (see Adelman, 1971; 1973b). 
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Instructional Content and Process 

The training involved (a) formal academic experience? (excluding 
outside reading), e.g., lectures, discussions, (6-8 hours/week) ; (b) 
practical experiences, e.g., actual and simulated observational and 
supervised participatory experiences (17-18 hours/week); and (c) 
various "informal" experiences, e.g., meetings (2 hours/week). More 
specifically, each trainee was Involved In class at the University 
approximately 6-8 hours each week. In practicum situations approximately 
15 hours/week (with at least 10 of these hours actually in school class- 
rooms), and In supervisory "feedback" sessions 2-3 hours/week. In 
addition, to facilitate coordination and Integration of these various 
experiences, as well as to provide for continuous evaluation of the 
program and for general problem solving, the professorial and supervisory 
staff met 2 hours per week for discussion with the trainees as a group. 

While we did not follow a course and unit orientation, since the 

University requires 36 units for a M.A. degree, the following summary 

descriptions were used as umbrella "courses" under which the needed 

4 

con^;etence could be developed. 

1) Assessment and Children with Learning Disabilities (L,D,)--In 
this area, the focus was on the process by which an Individual 
attempts to understand himself and others In order to describe, 
predict, explain, and make decisions regarding children with 
L. D. The primary areas for competence development Included 
observational, testing, and interpretative abilities. 



4Appendix B contains various materials from the pilot program, e.g., our 
initial conceptualization of the areas for Instructional concern, a 
pragmatic list of Intended outcome, a handout given to the participants 
to Introduce them to the program, an expanded outline plan for the 
research area, the M.A. comprehensive questions, and so forth. 
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2) Program Planning and Implementation in SpecicQ Education- -In 
this area, the focus was on the process by which available 
resources may be utilized purposively and appropriately to 
provide effective and efficient programs for exceptional 
children, in general, and the L.D. , in particular. The 
priimary areas for competence development included basic in- 
structional, curricular, class management, interpersonal, and 
self-corrective abilities. 

3) Consultation and Supervision-- In these areas, the focus was on 
(a) the process by which an individual i.::Lempts to assist a 
colleague's efforts to assess and solve a problem purposively 
and appropriately, and (b) the process by which an individual 
critically analyzes, evaluates, and guides programs and per- 
sonnel in order to facilitate the improvement of programs for 
which he is responsible. Competence in these areas was 
developed by strengthening the abilities listed in connection 
with assessment, program planning and implementation, and 
research; in particular, there was an intensive focus on the 
manner in which attitudinal and performance change are in- 
fluenced by group pressure and personality dynamics, as well as 
on intra- and interpersonal functioning. 

4) Research and Learning Disabilities-- In this area, the focus was 
on the process by which new facts are discovered and accepted 
conclusions are supported, rejected, and/or revised. The 
primary areas for competence development included both consumer 
and participant abilities. 

5) Seminar in Learning Disabilities--This course involved the 
intensive study of special topics rr-lated tt) Specific Learning 
Disabilities (as definp.d by the National Advisory Committee on 
Handicapped Children). 

6) Special Studies and Electives--Special interests and/or needs 
were handled via this mechanism. 

The courses were taken in the following sequence: 

Fall Quarter — Assessment and Children with Learning Disabili- 
ties; Program Planning and Implementation in 
Special Education 

Winter Quarter--Research and Learning Disabilities (part I); 
Seminar in Learning Disabilities 

Spring Quarter — Consultation and Supervision; Research and 
Learning Disabilities (part 2) 

Special Studies and electives were taken during any or all 
thrae quarters or in the summer. 
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Although all participants completed the required course work in 
three quarters > each individual had to demonstrate on a written exam 
and in actual classroom performance that she had acquired at least the 
minimal level of competence necessary for on the job success as judged by 
the professorial and supervisory stafC. In this connection, two parti- 
cipants needed to continue in the program longer than the 3 quarters 
necessary for completing formal unit requirements. Thus, while 
courses were taken and credit given just as in conventional programs, 
the primary emphasis at all times was on the development of competence 
and the only acceptable criteria for successful completion of the 
program was demonstrated competence. 

Program Evaluation 

As we indicated to the U.S. Office of Education in our original 
project proposal, while we are aware of what should be accomplished with 
regard to program evaluation, we also are aware that it requires consid- 
erably more resources (in terms of staff, instruments, and financial 
support) than we had available. Nevertheless, we did attempt to 
evolve some procedures for both basic and evaluative research purposes.^ 
In this connection, we focused on the development of procedures which 
could be used to gather pre- and post-program data. We had the program 
participants (and a contrast group of matched control subjects) attend 
two all-day sessions prior to the program's implementation and again 
at its conclusion. At these sessions, they responded to essay type 

^Our conceptual view of program evaluation is presented elsewhere (Adel- 
man, 1973a). 
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questlons covering the areas of assessment, program planning and 
implementation, consultation and supervision, and research; in addition, 
they critique<^ 3 research article and participated in a role play 
consultation situation which was videotaped. Ratings of in-the-field 
performance were made throughout the year for purposes of formative 
and summatlve evaluation. In this way, we were able to make some 
progress toward the development of procedures to assess program parti* 
cipant and non-participant behaviors and products in natural and 
manipulated situations at the beginning and at the end of the program. ^ 
In addition, we pilot tested a questionnaire designed to assess back- 
ground and experiential factors which might be importantly related to 
successful performance. It also should be emphasized that efforts were 
made to develop and pilot test procedures designed to assess the 
participant's impact on pupils (e.g., a pupil rating procedure involving 
a standardized performance situation and a teacher record keeping 
procedure). Finally, it may be noted that a follow-up study of the 
program graduates hap been initiated and will be continued.^ 

As a result of our project activity during the first year, we 
identified a number of specific developmental needs which should be met 
in order to enhance the change agent preparation program. Thus, during 
the second year, we undertook to evolve the conceptual foundation and 



It also should be noted that all program participants had to pass a 
battery of M.A. comprehensive questions at the end of the program. 

^The various procedures we have been experimenting with are included 

in a project product entitled Resource Guide: Program Evaluation (Duchon, 

Hull, and Carpenter, 1973). 
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varlous practices related to personnel preparation programs in general, 
and our type of program In particular* The next section is devoted to 
a discussion of the implications ve have derived from the activity of 
the past two years with specific reference to the preparation of 
change agent personnel • 

Implications Derived for Future Programs 
Again, there is no attempt to be exhaustive in this discussion, the 
Intent is to highlight some key topics. 

Selection of Participants 

We continue to believe that a basic prerequisite fci* any person 
entering our type of change agent program is that they have demonstrated 
effectiveness in 'leaching in a classroom and in relating to fellow 
teachers and administrators. Thus, a major entrance requirement should 
be convincing documentation of effective performance, e.g., not only 
testimonials, but actual observation by impartial Judges. A related 
consideration is the sponsorship of the applicant by a current or 
potential employer. The fact that someone not only is recomnending a 
person, but is comsltted to employing the individual as a change agent 
Is reassuring with reference to selection. It is also an added incentive 
for participants to successfully complete the program, and is the 
easiest way to eliminate concerns regarding subsequent placement of 
program graduates* 



^For further discussion of the question of admission criteria and 
accreditation see Adelnan (1973a). 



We bflirvr that t^.r tvp« of charge *gent wc hAVf t>«en fcxutirg on, 
..t., a professional who ;f retronaible for and caf^aMr of the 
lilffusion of ma i ntt reaming approaches^ is very much needed. While ve 
have atteTiipted to prepare turh personnel vithln the contemt of a 
l>nlversity M.A. vroKraa, such preparation clearly cc^^ld be offered In 
other conteKts. (The ii^vceritlve valw^e which acctues fro« offering an 
M.A. degree could be transferred tc a special certificate of ccm^e' 
tence if there Is a coo^arable Increase in salary.) 

*^«^d on our work over the past tvo years, we h«ve some*vhat re- 
vised and expanded our general conceptualization of what Is involved in 

the process of planning, inp lereent i ng , and evaluating J personnel 

9 

preparation program (e.g., see Figures 3 and 2). We also h.ave revised 
and expanded some of the specific assunipt 1 ons and orientations which 
were presented in the section of this paper describing the pilot program. 
In particular, we now conceive of the concerns ar^•s^nd which such a 
progr»«T»*« instructional content is developed as heing the tasks 
involved in: (1) systematical ly educating the nation's vouth, i.e., the 
tasks involved in fomiulating a program rationale -^nd in programs planning 
(curricular, evaluative, administrative, and instructional), inq^lenenta* 
tion, and evaluation with reference both to pupils in the general 
population and pupils with 1 earni ng/ behav i or problems, aj)d (2) the 
diffusion of such systeiDStlc programs, i.e., the process of facilitating 



^Also see Onra^^etency Rased Training: A Conceptual Vifc^ (Adelman, 1973a). 

iOElsewhere (A^lelman, 1973b) I have discussed the "main^treamirut** nature 
ef the approach which we took. 
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Figurt I. Th« ilroctst of Flannlns, laiplcaeat ing » and Evaluating 
M Educational frograa. 
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thc dittemination, installation^ aod mainteaance of change. We also 
would r«*f!Mphaslt« that such a proiran should be conceived of as 
involving (a) a pre-service phase, encon^assing the period up to the 
point vhere an individual is adjudged to be at least minimally 
qualified for the change agent role and (b) an in-service phase « 
encoofvassifig all subsequent formal education related to that particular 
role and designed to develop a high level of professional coapetence. 
Ideally, subsequent needs analyses of the change agent*s role, functions, 
and intended impact will expand our understanding of the coa^rehens 1 ve 
range uf knowledge, skills, and attitudes which must be learned. Such 
analyses also should help to clarify the levels of minimal competence 
which should be attained prior to **certlf ication,*' and, concomitantly, 
will clarify what the specific focus of the subsequent in-service 
program should be.^^ It also is worth restating that the instructional 
process employed in helping program participants develop needed compe- 
tence should involve coordinated and integrated academic, observational. 



this context, it is Interesting to note what the experts have to say 
about change agent characteristics, attitudes, knowledge, and skills. 
For a brief discussion of such matters, see Appendix A, In addition. 
Appendix C is an abstract describing alternative training models for 
change agents as presented In Havelock and Haveiock, Training for Change 
Agents (1973). 

12lt should be eo^hasized that the in-service program may not utr«ru Lu 
focus on the development of substantially new, general abilities, but 
may only require an Increase In level of competence. (T^ls also may be 
the case for many variations in on*the-Job demands. For example, a 
teachar In a classroom which contains youngsters %fho manifest severe 
learning and performance handicaps, i.e.^ special education classrooms, 
as contrasted with a teacher who do^s not have such youngsters » probably 
needs a hlghf^r level of competence in certain areas-^but not substantively 
different » general abllltles--to perform acceptably. This is not to t^iy* 
however, that (a)he won*t need to learn some new« specific procedures 
(Adelmanp 1972].) 
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and part ic ip«tory experiences^ with special emphasis on utilising a 
c cvny rehens \ ve a;rprent ice $h - 1 Ike wodel whenever \t is appropriate and 
feasible and on accomo ja 1 1 ng Individual differences motong prograa 
participants. In addition to its instructional facets, we have come to 
recognize that a personnel preparation program needs to state explicitly 
its non-curr icul ar goals, i.e., S^'ls related to admin -sterlng the 
program and to performing relevant research , in-service trainln;^^ and 
public service functions. And since the program has both instructional 
and non-curricular goals, the evaluation efforts should attempt to 
assess the program's positive and negative effect on the participants, 
on the p-D 's who are directly or indirectly affected by the partici- 
pants, on the relevant ctcnaouni 1 1 es , school districts, and institutions 
f4 high.r education, and cn the field in penera^ . 

I nstructional Content and Process 

For purposes of the following discusis^ion , which briefly reviews the 
topics of curricular planning, instructional planning, implementing 
instruction, and program evaluation, it is helpful to state our major 
goals for program participants. These highly abstract goals are: "Each 
participant is to acquire the ability and desire to plan. Implement, and 
evaluate systematically (1) a regular classroom instructional program 
which will improve the educational op'i^ortunit ies both of pupils in the 
general population and pupils with learning/behavior problems and (2) a 
program which results in the widespread diffusion of such a classroom 
program/' With these goals as critical referents, we can focus our 
discussion on the process of curriculum planning. 
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( urr i c«»lar PI onnin^ . Curriculum planning is the process l)y whicfj the 
above goals are translated Into an organized package of generic 
instructional objectives and procedures. Becauije of the complexity of 
this process, we do not have a '^package'' which can be presented here. 
What we do have is a framework (and some resources) which can be used 
in developing such d package. 

Content --From the above goals, we have aerived, empirically and 
rationally, eight areas for instructional focus, i.e., a focus on 
program rationales, curricular planning, evaluational planning, admin- 
istrative planning, instructional planning, program implementation, 
program evaluation, and **tools** needed to help advance the field. Based 
on our previous experiences, an additional preliminary area has been 
added, i.e., a focus on *'tools** needed for learning what is taught in 
the program itself. In each of these areaSo we have identified major 
components in a hierarchical fashion (see Table 1). 

Concomitantly, in our work, we categorize these area sub-divisions 
with reference to the type of instructional focus involved, namely, 
whether the focus is on acquiring (1) facts, (2) com^epts, (3) skills, 
(4) behaviors, and/or (5) attitudes. While these five "types" obviously 



^"'As I have indicated elsewhere (Adelman, 1972a), in planning program 
content, one must consider what is required for success in the program 
itself. For example, there may be skills needed for successful 
learning anc! performance in th^ preparation program which are not 
essential to successful performance in a given professional role. Thus, 
a systematic analysis of what is required for successful completion 
of the program is needed in order to (1) reform the curriculum, (2) 
improve selection procedures, and (3) plan early corrective action to 
improve the participants' chances of success. 



TABLE 1 

Major Sub-Areas for Inst ru(!t lonnl Kofus 



I. Tools Needed for Learning and Performing in the Program 

A. Procedures for Inquiry 

1. Reasoning 

2. Critical Reading 
3* Listening 

4. Learning and Performing Independently and Cooperatively 
Using Self-evaluative Feedback 

B. Procedures for Task*Oriented Consnunication (Sending and 
Receiving Messages) 

1. Non-verbal and Verbal Informative (Body Languagiis Written 
and Oral Language) 

2. Non-verbal and Verbal Interactive (Particularly Helping 
Relationships and Problem Solving) 

C. Survey of Major Concerns Confronting the Field of Education 
1* Progranmatic 

2* Population 

3. Evaluative 
II. Program Rationale 

A. Purpose of Educational Programs 

1. Socio-political- Economic 

2. Learner Self-actualization 

B. Forces Which Shape the Educational System 

1, Socio- Political- Economic 

2. Ideological 

C. Body of Theoretical and Qmpirical Knowledge Upon Which Programs 
Should Be Based 

1. Growth and Development 

2. Learning and Performance 

3. Motivation 

4« Instructional Content and Process 

5. Assessment, Evaluation and Research Processes 

6. System Ecology 

7. The Growing Field of Education 
III. Curricular Planning 

A. Evolution of Relevant Generic Curriculum 



1. 


Instructional Content 


2. 


Instructional Objectives 


3. 


Instructional Procedures 


4. 


Curriculum Organization 


Identification of Relevant Observable Behaviors 


1, 


Relationship Between Observables 


2. 


Implications for Program Planning, Is^lementation, and 




Evaluation 



IV. Administrative Planning 

A. Formulation of Non-Curricular Goals, Objectives, and Procedures 
1. Administrative 
2w Research 

3. In-service Training 

4. Public Service 
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B. Identification of Relevant Observable Behaviors 

1. Relationship Between Observables 

2. Ixi5)lications for Program Planning, Implementation, and 
Evaluation 

C. Identification of Available Resources, Organizational Alterna- 
tives, and the Population to be Served 

1» Techniques for Analyzing Resources 

2. Inqplications of Resource Availability for Recruitment, 
Selection and Admission of Program Candidates 

3. Principles and Practices of Administrative Organization 

D« Decision Making Regarding Dispersal of Population and Resources 
and Scheduling 

1. Recruitment, Selection, Admission, and Dispersal of 
Population 

2. Deployment of Resources 

3. Continuous Monitoring of Resource Use 

4. Scheduling Relevant Program Planning, Implementation, and 
Evaluational Activities 

V. Evaluational Planning 

A. Formulation of Relevant Instructional or Non-Curricuiar 
Evaluation Procedures 

1. Identification of Available Procedures 

2. Adoption or Adaptation of Available Resources 

3. Development of New Procedures 

B. Specificity of Evaluation Procedures 

1. Generic 

2. Program Specific 
VI. Instructional Planning 

A. Modification of Relevant Generic Curriculum to Accommodate the 
Specific Groups to be Served 

^» Broad Band Assessment 

2« Evolution of Instructional Objectives, Procedures, and 
Organization for Specific Groups 

B. Modification of the Group Plan to Accommodate Individuals 

1. Narrow Band Assessment 

2. Evolution of Instructional Objectives, Procedures, and 
Organization for Specific Individuals 

VII. Program Implementation 

A. Initiation of Planned Program 

1. Facilitating Activation of Participants 

2. Facilitating Focused Behavior 

3. Facilitating Initiation of Activity 

4. Facilitating Maintenance of Participation 

5. Facilitating Appropriate Communication Between Participants 
Regarding; Results 

6. Strengthening Learning and Performance Patterns 

B. Formative Evaluation 

1. Description of Instructional and Non-Curricular Antecedents, 
Transactions, and Outcomes 

2, Judgement of Instructional and Non-curricular Antecedents, 
Transactions, and Outcomes 

3« Decision Making 
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C. Modification of Planned Program 

1. Modification of Instructional Objectives, Procedures, and 
Organization 

2. Modification of Non-curricular Objectives and Procedures 

D. Ongoing Management of Program 

1. Materials 

2. Methods 

3. Behavior Settings 
VIII. Program Evaluation 

A. Description 

1. Identification of Intended Antecedents, Transactions, and 
Outcomes 

2. Measurement of Anticipated (Intended) Antecedents, ^ 
Transactions, 3nd Outcomes 

3^ Identif icatioii and Measurement of Unanticipated Outcomes 

B. Identification of Standards 

1. Absolute (Criterion Referenced) 
2e Relative (Norm Referenced) 

C. Judgements and Decision Making 

1. Derivation of Implications Based on Judgements of Intended 
and Actual Antecedents, Transactions, and Outcomes 

2. Derivation of Implications Based on Judgements of Unanti- 
cipated Outcomes 

3. Initiation of Action 

IX. "Tools" Needed to Help Advance the Field 

A. Methods for Inquiry 

1. Purpose of Educational Inquiry 

2. Types of Methodological Activity . ^ 

B. Planning and Implementation of Activities for Inquiry 

1. Designing Internally Valid Inquiries 

2. Special Techniques for Specific Activities 

3. Derivation of Externally Valid Implications 

C. Development and Diffusion of Prototype Program Models 

1. Development of Feasible Prototypes 

2, Dissemination, Installation and Maintenance of New Programs 
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could be subsumed under the rubrics cognitive, psychomotor, and affective 
domains, we have found It more comfortable to work with the five cate- 
gories named above. Whatever terms are used, however, the important 
point for emphasis is that such all-inclusive terms as "knowledge" 
and even the phrase ''knowledge and skills" tend to mask the full nature 
of the content which merits instructional focus. 

The matrix we have evolved as part of our conceptual framework 
for generating the instructional content of any program designed to 
prepare such educational personnel as teachers, supervisors, consultants, 
and instructional "resource" professionals (such as change agents) is 
presented in Figure 3. Potentially, each cell of the matrix represents 

a segment of such a program's content which car* be evolved into sets of 

14 

instructional objectives for preparing prospective change agents. 

At this point in the discussion, it is worth emphasizing that 
regardless of the approach used in evolving instructional content any 
specification and grouping of the set of observables encompassed by a 
goal-construct essentially constitutes a theory regarding how such 
observables relate to one another. For every program of systematic 
instruction, then, such theory is a primary basis for all subsequent 
program planning, implementation, and evaluation. From this perspective, 
the problem of developing better instructional objectives is viewed as 
involving theory building as well as empirical identification of what 
is required for successful performance of various school roles and 



^^See Adelman (1973a) and Carpenter and Hull, (1973) for a discussion of 
some key sources of information for generating instructional content* 
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functions with differing populations. 

As is suggested above > the matrix presented in Figure 3 is very 
useful in shaping the nature of the instructional content of our 
program. In limiting the scope of program content > we are concerned 
primarily with two major dimensions. One dimension encompasses the 
timing for instructional focus; the second encompasses the degree of 
mastery and/or involvement to be achieved by the program participants. 
The former is concerned with matters such as the patterning, sequencing, 
and duration of instruction. The latter is concerned with the level 
to be attained with reference to each instructional objective which 
has been evolved. That is, given continua ranging from low to high 
levels of cognition, performance ability, and attitudinal involvement, 
what levels are to be attained? The final answer to this question, 
of course, must reflect tho level of competence that will be acceptable 
in performing a given job function or set of job functions — thereby, 
once again, emphasizing the inqjortance of evolving specific knowledge 
of on*the-job requirements. At this time, in determining whether 
satisfactory levels of competence have been attained to warrant certifi- 
cation, a reasonable strategy seems to be that of evaluating at 
appropriate times complex, major behavioral outcomes, e.g., the 
instructional plan for a given day, a total d^y of instruction, a 
critique of a research article, and so forth. In judging the adequacy 
of such behavior, I am afraid we will have to rely on a combination of 
expert judgement and relative comparisons (e*g. , among the program 
participants) until we finally establish, empirically, some appropriate 
standards . 
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Ultlmately both the nature and the scope of instruction are 
limited by the decision making process which leads to the adoption of 
certain instructional objectives and the rejection of others. Decision 
making as to what constitutes an appropriate instructional objective, 
of course, is a complex task. It involves the application of criteria 
for judging (1) the "power" (usefulness) of what is to be learned--this 
includes questions of construct validity and content generality--and 
(2) the" economic" feasibility of what is to be taught--this includes 
consideration of (a) the total number and level of objectives to be 
accomplished using a given amount of time, space, teacher competence, 
etc., and (b) the characteristics of the individual to be instructed. 

Objectives which are both potentially powerful and economical 
generally will enconqpass more than one observable behavior and will 
be stated at a somewhat low level of specificity. (The lower the 
level of specificity, the higher the level of abstraction.) From 
this perspective then, the argument that all instructional objectives 
should be stated with a high degree of specificity is seen as fallacious^ 
What is important is that the observables encompassed by an instructional 
objective be identified and understood. (See Figure 2 and note that 
in the curricular planning phase after relevant generic instructional 
objectives and procedures are evolved there is still the task of 
identifying the set of related observables represented by the supra- 
ordinate goals.) Indeed, it should be reenq)hasi2ed that Instructional 
objectives should be stated with a low level of specificity (a) whenever 
it is more economical to teach at a low level of specificity because of 
the likelihood of good transfer of training, e.g., whenever the "whole" 



-48- 



(a general principle) can be taught appropriately instead of having to 

teach each separate part (each specific case), and (b) in many instances 

when only a low level of mastery and/or involvement is to be attained , 

e.g. 9 teaching teachers about curriculum theory. Furthermore , Instruc* 

tional objectives will be stated at a low level of spr^ciflcity whenever 

the set of related observables represented by the program goals are not 

very well identified or agreed upon.^^ 

Ideally, every component encompassed by an instructional objective 

I 

should be identified even when such objectives are fairly abstract. 
Howev ir, this frequently will not be the case. As a result, systematic 
efforts designed to plan, implement, and evaluate programs for change 
agents (5nd all other education professionals) must settle for being 
less than ideal, at least for the present. For example, when many of 
the specific components of an instructional objective are not known, 
such objectives will be imprecisely understood and subject to varying 



^^It should be noted that in the literature on the use of objectives in 
curricular and instructional planning some writers distinguish between 
general, terminal and enabling objectives, each of which is seen as 
serving a different purpose. Anmerman and Melcfcing (1966) state: 
"The general objectives consists of statements of general performance, 
such as jobs, duties, functions, or other activities that incorporate 
more than one meaningful unit of performance. . . . They are useful as 
very brief descriptors of the instructional objectives, but they are 
too general to be meaningful and useful in designing learning experi- 
ences'* (p. 76 in Merrill, 1971). "A meaningful unit of performance is 
an activity that would be done in its own right in the intended work 
situation. . . . Student performance objectives in which the student 
action is stated at the level of a meaningful unit of performance are 
called terminal objectives. . . . After the terminal student performance 
objectives have been established, the next activity is directed at 
determining what the student needs to learn; that is, to determining 
the enabling objectives. . . the component actions, knowledges, skills, 
and so forth, the student must learn If he is to attain the terminal 
objectives" (p. 75 In Merrill, 1971). 
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lntcrpr«t«t lont thereby produclnf undeelrrd variations In profrMi outcows. 
in addition, the lack of kntovledfe regarding such cCHnponentt hat a 
negative effect on program evaluation efforts by hlnderimg the proceAf 
of sMipllng vhat prograa participants have been learning. 

T^e above dlicuttion thotild not be interpreted at an arguMnt for 
Halting change agent preparation prcgramt to Intt rue t lonai cbjectivet 
for vhich all cowponentt tre kncwn. To the contrary, at hat b««n 
ttated abos/e» given our current ttate of knowledge, ir ail areat for 
int t ruCt ional focut many Iv^ortant covaponentt are poorly underttood or 
are not readily obterved (Matured), and that Inttruc t ional objecttvrt 

vhich are Intended to encooiratt thete cooiponentt can only be formulated 

1 

at a rather high level of abttraction and anblguity. 

The organisation of content for purpoi^rs of instruction is 
discussed in a subsequent section of this paper. In anticipation ^f 
that discussion, it should be noted here that instruction is f*-n always 
organised around a gWen instructional objective. Frequently, instruc* 
tion lo better facilitated by grouping a number of instructional 
objectives under one or more organising topics. 

Instruct lof\al Procedures - *Qnce a set of generic instructional 
objectives have been evolved, the f'>cus of currlcular planning shifts to 
the probleoi of establishing a set of gener Ic instructional procedures 
vhich can facilitate the acquisition of the objectives by the program 

^^IVo products of our project activity provide references to a sampling 
of the listings of objectives %rhich currently are available (Adelo^n. 
1973a; 1973). Obviously, our view is that such listings should not 
simply be Adopted t>ut should be used as s resource for derivinff 
instruct ionjil content. 



r«rtici^«ntt. S^ch ^roccdvrcs mv W thCMaght of in tcrM of vl&at tKc 
instructor ido#t in or4«r to facilitate th« progran participants* 
invoW^wnt In appropriate cxpsrltncca. Km indicated in flgum <i, (a) 
the lnatructor*s procedural concerns can be categorlied at Involving 
methoda^ materials, and behavior settings, and (b) the program parti- 
cipant's Involvement can be categorited as acadewlt at im^l at iort , 
practice, an^ communicat ion*or iente4 experiences. 

With reference to these categoriea of procedures and exiper i< nces , 
Such quest irns arise as: What methods and materials should a program 
participant eK^erie^ice? Where and how long should these methods and 
materials be exiper ienced? What ]^opulatlon(s ) should be focused on? 
/ho should b# involved in fAcilitatinf the instructional ptoceas? 
T^ese queations serve as a general f ram ever k for the discussion which 
f ol lows . 

The answers to these questions require: (1) the idet^t i f icat ion 
of u variety of potsntislly useful prr>csdures (and» where n«cesaary« 
an indication of how to locate and jae such procedures); snd (2) the 
selection of those procedures which can appropriately facilitate the 
acquisition by the participants of the program's Instructional objec- 
tives (see Figure S). (T^e selection of procedures involves the 
assessment of time. cost, and performance desMnds for alternative 
procedures- -fol lowed by ths elimination of procedures which are 
inappropriate because such demands are urrealiatic or unfeasible at 
the present t imt. ) 

A general discussion of these topics and questions is presented 
elsewhere (Adelman. 1973a; Carpenter and Hull, 1973). for cur purposes 
here» it will suffice to highlight the following points. 
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1) Methods can be differentiated into models of teaching* 
activities and techniques and defined as follows: 

Hotels of Teaching >>"a pattern or plan^ which can be used to shape 
a curriculun or course, to select instructional materials, and to 
guide a teacher* s actions/* The model used by an instructor has 
** « . . much to say about the kinds of realities which viP be admitted 
to the classroom and the kinds of life*viev which are likely to be 
generated as teacher and learner work together** (Joyce and Weil, 
1972b, p« 3)« It should be noted that some models are more prescriptive 
than others with reference to the types of activities and techniques 
which are to be employed. 

Activities * 'Specific types of experiences which a student can be 
involved in alone or with other students and/or with instructors, 
academic stimulation such as reading a book, practice such as teaching 
a child, cooDunication^oriented experiences such as group meetings. 
Such experiences may or may not be prescribed by a particular model. 

Techniques * -building certain specific characteristics into the 
stimulus, response, and feedback facets of an activity, e«g«, use 
of varying combinations of sense modalities such as Fernald*s tracing 
(AVKT) technique for learning words; varying Intensity, duration, 
patterning, cueing; requiring overt responding; variations with 
reference to incentives and reinforcement such as contingency 
ma/iagement 

2) In discussing instructional (including related assessment) 
materials , it is helpful to differentiate between the medium and the 
neasage* For example: Media include (1) machines, (b) prepared 



-56- 

matcrials such as films, audio and visual recordings, packaged programs, 
textbooks, tests, and other verbal and graphic representations; (c) 
special apparatus and other real objects; and (d) the instructor and other 
resource people. The message is the instructional content which we have 
categorized in this presentation as being facts, concepts, skills, 
behaviors, and attitudes (see Figure 3). 

At times, the distinction between methods and materials and, indeed, 
between content and procedures tends to be too artificial. For exai^ple, 
with great relevance for this discussion and again anticipating the 
subsequent discussion of curriculum organization, se\reral writers have 
identified a currtcular concept called an organizing center* Such a 
center is "the theme, topic, problem, or project whfich give? imnediate 
purpose and direction to the undertaking of a number of learning 
experiences. The popularity of ar organizing cent«£r stems from the 
assumption that learning best occurs when the learner is confronted with 
a problematic situation* In the resolvement of the problem, relevant 
information, methods, and details acquire significance. Further, the 
tension generated by the problem in believed to 'motivate' the learner" 
(McNeil, 1965, p. 79). (It should be remembered that the organli:ing 
center is only a focal point for facilitating learning with regard to 
specified instructional objectives, e.g., the program participants* 
^<^mpletion of a project is of secondary importance to their learning the 
content represented by the instructional objective.) 

3) Once decisions are made with reference to what methods and 
materials might be used to accomplish the genericaily formulated 
instructional objectives, the focus In curriculum planning tuois to the 
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questlons which involve decision making regarding the behavior settings , 
the length of ti»^ to be devoted to various experiences, and the popula - 
t ion(s) to be focused upon. Generally speaking, (a) the behavior 
settings may vary in terms of organizational format for instruction 
(e.g., staffing pattern, student grouping), type, locale, and scope 
(e.g., public-private; school ^comraunity, degree of uniqueness; sparse- 
ample facilities and equipment; minimal -maximal availability and use) 
and climate (e.g., interpersonal, intrapersonal , physical)-''See Table 2 ; 

(b) a participant's experiences may vary temporally from brief to 
extensive and from intermittent to continuous involvement;^^ and finally, 

(c) such experiences may be designed to expose participants to a 
variety of adult populations, e.g., teachers, consultants, other 
professionals, parents, etc., and to a variety of pupils, e.g., who 
are of different ages, who are considered exceptional children, and so 
forth. 

4) With reference to the question of who should be involved in 
facilitating the instructional process, decisions regarding who will 
have primary responsibility likely will vary with the locality. This 
is true for specific activities and for the program as a whole. In both 
cases, who has the responsibility is probably not as important as that 
someone has it, for it is that someone who must be certain that there 
is coordination and integration. With reference to the total program, 
the responsibility could be centered in one agency--e . g. , an institution 

l^It should be clear that, before convicting the program, a partici- 
pant will spend a large portion of time in the "field" (as contrasted 
to time spent in university or college classrooms). 
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of higher education, or a school district, or it could be shared by 
several agencies. 

5) After potentially useful procedures have been identified, the 
next major activity involves the selection of those procedures which 
appear to be most appropriate for achieving the generic instructional 
objectives. In doing such selection, Adelman (1972b) has suggested 
that the problem is first of all one of determining which procedures 
have the most potential for (a) attracting and focusing program partici- 
pants on relevant stimuli; (b) initiating and maintaining appropriate 
participation; (c) producing appropriate communication between instruc- 
tors and program participants regarding results; and (d) strengthening 
preceding learning and behavior patterns of program participants and 
instructors. Given two procedures which are of equal potential with 
regard to such criteria, selection would be based on the procedure's 
likelihood of producing "side effects." That is, if one of the proce- 
dures not only produces the desired instructional outcomes, but also 
produces undesired side effects, it would not be given preference. In 
contrast,/ a procedure which produces both the desired outcome and other 
positive outcomes (or reinforces the desired outcome) would be strongly 
favored. 

Curriculum OrRanization --Af ter appropriate instructional content and 
procedures have been identified and selected, there is a need for 
patterning and sequencing, e.g., determining whether there is a need for 
certain instructional objectives and procedures to be placed in a 
particular juxtapostion to one another. As should become clear from the 
following discussion, one organizes the content and then, if necessary. 
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readjusts the procedures which tentatively have been selected for use in 
teaching that content. It also should be evident that such organizational 
problems permeate a program's curriculum. That is, each unit or module 
has to be organized internally and has to be coordinated and integrated 
with other program curriculum units. (At this point in the discussion, 
a unit or module can be described as consisting of a coordinated and 
integrated set of instructional objectives and procedures which relate 
to a specific sub-area of instructional focus such as the sub-areas 
presented in Table 1.) 

In discussing such curriculum organization, McNeil (1965) suggests 
that *'good cirriculum organization meets three specifications: (a) 
There is planning for review and reiteration of that which has been 
learned . . . (this is called) the criterion of continuity, (b) . • . 
the curriculum must extend that learning in depth , , , (called) the 
criterion of sequence. . • . (c) The skills, values, and concepts 
taught in one area of study should be related to the other areas of 
study . . . the criterion of integration. , . (pp. 68-69). McNeil 
continues: "The heart of the organizational problem is being clear 
about the instructional objective and identification of the steps 
necessary to its attainment. Subsidiary questions involve how best 
to order these steps for effective learning. . . . Unfortunately 
curriculum inquiry has not advanced to the place where we know what 
constitutes necessary steps in the attainment of objectives. Many 
so-called prerequisites are just so much busy work** (pp. 69-70). 

Planning for equivalent and analagous practice (e.g., review and 
reiteration) is a rather self-evident activity. Sequencing, however, 
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requires some organizing principles, and a number of suggestions have 

been offered, e.g., chronological presentation, emphasis on breadth or 

on depth of application, easy to difficult, part to whole, simple to 

complex, concrete to abstract, theory then practice, familiar to 

unfamiliar, and so forth. Unfortunately, it is uncertain when a specif 

principle should be applied. That is, while a part to whole sequence 

may be appropriate for accomplishing one objective, a whole to part 

sequence might be more appropriate for another objective, and a combi-' 

nation of both may be more appropriate for a third. 

If the situation is viewed as bad with regard to sequencing princi 

pies, it can only be viewed as horrendous with regard to organizing 

principles for facilitating the integration of the various components 

1 ft 

of instructional content. It is clear that the knowledge base for 
evolving a coordinated and integrated curriculum is very weak. Thus 
the task remains more of an art than a science or even a craft. 

In practice, it appears as if few programs have even attempted 
significant coordination and integration within the pre-service or 
in-service phases and/or between these two phases. Most commonly, the 
different experiences are initiated haphazardly, with little awareness 
of what competence a participant already has acquired and with little, 

l^One relevant construct frequently emphasized in the literature on 
change is that of synergy. This construct emphasizes the need for 
redundancy and diversity (e.g., repeated inputs from different sources) 
and, hopefully, synchronicity. As Havelof:k and Havelock (1973) state: 
"The simplest example of synergy occurs when two separate individuals 
give the same piece of advice* Two inputs from two different sources 
are far more persuasive than the same input from only one source. In a 
sense, synergy produces a validation of experience." 
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if any, coordination with other concurrent or future activities or with 
other program experiences. 

The types of planned relationship between academic, observational, 
and participatory experiences which should be occurring is represented in 
the diagram below. As may be seen, there should be constant interaction 
between the various types of experiences. For example, when a demonstrable 
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concept or technique is introduced academically, the program participant 
should have the opportunity to observe a demonstration and to engage in 
unsupervised practice, as well as in supervised practice where he can 
receive guidance, feedback, and additional demonstrations; in addition, 
he should have the opportunity to raise questions for discussions based 
on his academic and participatory experiences. In turn, the feedback 
which these discussions provide should help those responsible for the 
program to determine what should be presented, practiced, and discussed 
subsequently. 

In organizing these experiences, the notion of organizing topics 
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and centers mentioned earlier is a very helpful concept. A corollary 

idea which has been receiving increasing attention recently is the 

19 

concept of instructional modules^ A good example is found in the 
work of Arends. Masla, and Weber (1973). These authors define such a 
module as "a set of learning activities intended to facilitate the 
studfjnt's achievement and demonstration of an objective or set of 
objectives,^' (p. 3). ITie elements of such a module are described as "an 
objective or objectives;, prerequisites, pre-assessment procedures, 
learning alternatives, post*assessment procedures, and remediation 
procedures" (p* 22). In keeping with the di&cussion presented earlier 
in this chapter, it should be noted that sotae programs build each 
instructionaJt module around a group of related observables; others build 
a series of modules, each of which encompasses only one or two observa-- 
bles« Paraphrasing Arends, Masla, and Weber (1973), whichever format is 
used, the point is clear: a ^^ingle observable outcome can rarely stand 
•alone. ''Human behavior is far too complex a process to expect isolated 
outcomes to be meaningful" (p. 22). It also should be noted that 
instructional modules may produce outcomes which have not been specified 
in advance, i.e., which are unanticipated. Such outcomes may be undesired 
or they may be previously unidentified components of a somewhat abririxt 
intended instructional objective. Other discussions of modules may be 

19 

As Jones (1972) points out, such units also have been called a 
molecule, a UNIPAC, a WILKIT (Weber Instructional Learning Kit, Weber 
State College), and so forth. Joyce, Morine, Weil and Wald (1971) list 
and describe many modules which can be ordered. The resource guide 
regarding instructional planning which is a companion work to the 
present monograph also provides additional discussion and references 
to modules. 
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found In Altman, Qiaridler, Connoly, and Meyen (1971), Houston, Hollis, 
Jones, Edwards, Pace, and White (1971), and in Joyce, Morinc, Well, 
and Wald (1971). 

Again, it should be emphasized, however, that ideas such as topics, 
centers, and modules are only focal points for facilitating organiza- 
tion and learning with regard to specified instructional objectives. 

While coordination and integration of key experiences are necessary 
facets of a program, it is important to recognize that such coordination 
and integration are not sufficient. The experiences must be qualitative- 
ly good and quantitatively appropriate. Of special Inportance in this 
connection ray be whether or not a program uses a comprehensive ••appren- 
ticeship-like" process with reference to those experiences which involve 
supervised practice. hSost supervised practice rarely resembles a 
comprehensive apprenticeship process since one of the most Important 
aspects of the apprenticeship model generally is missing. This aspect 
is the opportunity (a) to observe the '•master^^ perform his craft, (b) to 
have supervised practice with regard to what was learned, and then (c) to 
observe some more, and so forth in cyclical fashion until the level of 
minimal competency is reached and assured. Indeed, it is one of the 
grer.t ironies of pre-service programs that participants so rarely have 

the opportunity to watch a '"master" perform (i.e., plan, implement, and 

20 

evaluate) for an extended period of time. 



20For example, in practice teaching the student often is required to 
assume respotislblllty for the entire operation of the class by the second 
week of the assignment and from that point on only has verbal exchanges 
with the supervising teacher. As a consequence, many teachers have 
served their apprenticeship without having had the valuable experience of 
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In view of the cotnplcxity of the varicnis facct!» ct curricular 
planninf which have been sun&arlzed in this section. it seems evident 
that such planning requires a good deal of resources, particularly 
individuals with expertise in curriculum development. (Unfortunately* it 
has only been recently that any significant amount of resources have 
been directed toward curricular planning for personnel preparation 
programs; and in no way are these resources seen as being sufficient.) 
Of course^ as has been suggested above^ even the most expertly planned 
curriculum requires effective implementation. And, prior to its imple- 
mentation, there is a need for appropriate evaluat ional » administriit Ive » 
and instructional planning. Again, it is emphasized that these 
topics are discussed el.sewhere (Adelman, 1973a; Carpenter and Hall, 
1973; Duchon, Hull, and Carpenter, 1973), In the following section 
discussion is limited to summarizing some key points with reference to 
planning and implementing instruction and evaluating the program. 



seeing their supervising teacher perform over a period of several weeks-- 
that is, they were deprived of the chance to see a good model of teaching. 
And, of course, once a teacher accepts a full-time position, there are 
few opportunities for observing a colleague perform for any length of 
time. Thus, many teachers have not truly served an apprenticeship; it 
is Intl. resting to speculate as to the impact this has had on their 
performance. It is recognized that a major problem hampering the use of 
a comprehensive apprenticeship process is the lack of agreement as to 
what constitutes a "good teacher." This problem, however, should not be 
allowed to overshadow the potency of modeling as an instructional process 
in preparing change agents (see McKnlght, 1971; Gage, 1972). 

2^Uith the above discussion as background, the reader should review the 
"San^le Model of a Fully Developed Training Design" for preparing change 
agents (in Havelock and Havelock, Training for Change Agents , 1973). An 
abstract of this and other alternative models for training such 
personnel is presented in Appendix C of this monograph. 

ERLC 
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In<truct lonal Planning . The reader probably already haa recognised that 
much of the plannlnf which has been dlacusted as ociurrlng during a 
curricular planning phase does not happen currently. Therefore, the 
general tasks involved in curricular planning are left for the instruc* 
tional planning phase. This, Indeed, Is unfortunate since the specific 
tasks involved in the instructional planning phase sre deiundlng enough. 

In contrast to curricular plannlxxg, Instructional planning should 
deal with the problea of deciding the specific nature and scope of a 
particular program^s instructional content and process. Three major 
tasks of instructional planning are explored here: (I) the fomulation 
of relevant instructional objectives, procedures, snd organisation for 
participants as a group; (2) the aaseaament of each participant's 
interests, needs, behavior patterns, and response capabilities; and 
(3) the formulation of relevant Instructional objectives, procedures, 
and organization for individual participants. 

Permeating these three tasks are the processes of: (1) identifying 
the types and location of available assessment procedures and curriculum 
packages (e.g., an organized set of generic instructional objectives and 
procedures and related evaluation procedures); (2) adopting or adapting 
appropriate and feasible assessment and curricular resources when they 
are available; (3) developing new assessment anc* curricular resources 
when necessary and within the limits prescribed by time, cost, con^etence, 
and so forth (see Figure 6). 

If appropriate curricular and administrative planning have been 
accomplished, the first task of instructional planning encompasses 
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the following ateps: (a) reviewing the asscssmcMit data on the candi- 
dates who have been admitted to the program (with an awareness of the 
limitations of such data), (b) identifying and selecting curriculum and 
evaluation packages which are Judged to be appropriate foi such candi- 
dates, and, if necessary, (c) modifying (adding to, altering, deleting 
from) such packages. Such planning can be accomplished prior to meeting 
with the program participants and provides much of the framework for 
Implementing instructional and evaluatlonal activity. 

In addition, however, if a program is to be effectively person- 
alized, instructional planning also must involve finding out more 
about the individual program participants than can be found in the 
initial selection data. Such an assessment can be accompltshed through 
additional testing, questionnaires, interviewing, and observation. We 
have found it particularly helpful to set up the first few contact 
sessions as orientation and assessment sessions (rather than as lectures 
or general discussions). The major purposes of these sessions is to 
gather information and to involve the participant in planning variations 
in environmental circumstances in order to facilitate an appropriate 
match between (a) a participant's interests, needs, behavior patterns, 
and response capabilities and (b) the instructional objectives, 
procedures, and organization, Ihe success of such instructional plan- 
ning will be reflected by the reduced amount of trial and error and 
redundancy required to produce appropriate learning outcomes and the 
addition of personalized procedures and outcomes. For example, such 
•*pre-assessment" can result in (a) the addition of instructional objec- 
tives designed to develop prerequisite skills which a candidate may not 
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have acqulr;dy (b) the deletion of objectives in areas where the candi- 
date already has attained the appropriate degree of mastery, and (c) the 
addition of **enrichment** opportunities for specific individuals, e.g., 
some candidates may want to learn to speak Spanish because they are 
planning on working in areas which serve Spanish-speaking populations. 

The assessment procedures which provide the information needed for 
such instructional planning can be categorized (as can Instructional 
practices) in terms of whether they are designed for large groups, 
small groups, or an Individual. Thus, ve label practices designed for 
use with large groups "broad-band*' practices and those designed for 
small groups or individuals are categorized as "narrow-band" practices. 
In this context, it can be emphasized that in planning which broad-band 
teaching practices to use, the instructional planner should know about 
the general interests, needs, behavior patterns, and response capabili- 
ties of the candidates who have been accepted into the program. For- 
tunately, (s)he may already know something about such factors because 
of knowledge about past program participants and available normative 
data about human behavior. Assessment in such instances, then, 
essentially is a matter of determining whether or not most of the 
program participants correspond to such norms. If a particular group 
of candidates varies significantly from such norms, the assessment 
data provide useful information for planning broad-band instructional 
practices which will allow for an "appropriate match" for the large 
majority of participants. For economical and other reasons, such 
assessment data can and should be gathered through the use of broad-band 
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assessment practices* In planning which narrow-band instructional 
practices to use, the instructional planner should know about the 
specific interests, needs, behavior patterns, and response capabilities 
of a particular participant. (Again, our knowledge of behavioral 
notns will be helpful.) Assessment in such instances is oriented to 
the individual and should be designed to provide specific guidance for 
varying environmental circuits tances to facilitate learning for that 
individual. While broad-band assessment practices (e.g., standardized 
aptitude tests) often can be used for such purposes, narrow-band assess- 
ment practices (e.g. , personal interviews) usually are necessary as well 

Based on such broad- and narrow-band assessment data, then, 
instructional planning can be directed at making any necessary and 
appropriate modifications with referebee to available curricular and 
evaluative resources. That is, (a) available curricular and evaluation 
resources can be adopted or adapted and, if necessary, (b) new curri- 
cular and evaluation resources can be developed. Once these instruc- 
tional planning activities are accomplished, final pre-instruction 
decisions can be made regarding scheduling, grouping students, an^* 
deploying paid and volunteer personnel. 

Implementing Instruct ion. At this point, it should be noted that it is 



^^Merrill (1971) discusses three types of pre-tests: (1) prerequisite 
pre-tests, designed to determine whether the student has acquired needed 
antecedents, (2) diagnostic pre-tests, designed to determine if the stu- 
dent already has acquired aspects of the intended instructional outcomes 
and (3) terminal behavior pre-tests, designed to see if the student al- 
ready is performing to criteria with reference to intended instructional 
outcomes* 
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assumed that all learning which occurs in a "classroom** is not, will 
not, and should not be the result of an instructor's efforts to provide 
formal instruction* For example, it seems evident that no instructor 
is able to teach successfully all the skills which can be detailed and 
sequenced as being needed by the beginning teacher who will >^e teaching 
reading; even if it were possible, there is no satisf actv-^y evidence 
that this type of approach to the instructional and learning processes 
is necessary or desirable. In keeping with thi: assumption, the 
instructor's function is viewed not only as that of instruction, but 
of facilitation as well, i.e., a person who leads, guides, stimulates, 
clarifies, supports* Consequently, (s)he must know when, how, and what 
to teach and also know when and how to structure the situat on so that 
students can learn on their own*^^ of course, if students are to assume 
responsibility for their own learning, they should be involved in many 
facets of program planning, implementation, and evaluation. 

It also should be emphasized that, ideally, all personnel prepara- 
tion programs should be personalized programs. Personalized (as 
differentiated from individualized) instruction is viewed as successfully 
accommodating individual differences in development, performance and 
motivation* Even if one assumes that developmental differences will be 
of negligible importance and if one ignores the importance of motivational 



^-^In this context, it is interesting to note that much more learning 
than formal instruction might take place in some classrooms. The whole 
discussion presented above is suggestive of the importance of focusing 
first on the question of when and how students learn and then consider- 
ing what an instructor's role and function should be with reference to 
classroom learning. 
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factors. It is obvious that the program participants will differ in 
terms of iimediate performance abilities, particularly with regard to 
the rate at which they become proficient enough to meet specific 
performance criteria. Clearly the problem of accommodating such dif* 
ferences in pace is eased in a flexibly scheduled, competence-oriented 
program as contrasted with a program which adheres to a rigid, formal 
course, unit, and hour format* Hopefully, besides differences in 
performance rate, other individual differences will be accommodated 
as well, e.g., special support for any participant who lacks a prere- 
quisite skill. More generally, if a program is to be effectively 
personalized, it is probably important that the students and the 
instructors perceiV'i^ themselves as participants in an educational 
enterprise which encourages innovation and continued experimentation. 
It is such a perception wlhich contributes greatly to increased enthusi- 
asm and additional expenditures of effort. In this sense personalized 
programs may be viewed as involving, in great part, an institutionali- 
zation of the Hawthorne effect. While the Hawthorne effect usually 
denotes a temporary and deceptive effect, there is no theoretical 
necessity for the positive attitudes and increased behavioral output 
which result from being part of an experimental program to be temporary 
or deceptive in nature. The personalized program lends itself to the 
inclusion of such phenomena as a stable and positive aspect of the 
learning situation. What is being advocated is not complete novelty or 
novelty for its own sake, but a continuing emphasis on innovative 
practices to help elicit and maintain instructor and student interest 
and effort. What could be more appropriate in a program designed to 
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prepare change agents*^^ 

These points aside, the major tasks involved in implementing 
instruction are (1) the initiation of planned instructional activity, 
(2) ongoing assessment of instructional activity, and (3) modification 
and ongoing management of instructional activity* The discussion here 
is limited to a paragraph summary of what is involved in the ongoing 
management of instructional activity. The reader is referred to Adelman 
(1973a) for a fuller discussion of the various facets of program 
implementation* 

Ongoing instructional management can be viewed as involving two 
major concerns. One concern is how to structure the environment in a 
way which is compatible with the fostering of each involved person's 
desire and ability to learn or perform* A second concern is how to 

interact effectively with pertinent others, both within and outside the 

25 

program. (In dealing with such concerns it is well to recognize that 
efforts to overcome the various problems which arise include not only 



24schalock and Garrison (1973) suggest that seven conditions must be 
met before a preparatory program becomes genuinely personalized: (1) 
person-to-person experience must be planned; (2) a variety of instruc- 
tional-learning options must be available to meet individual needs; (3) 
students must participate in the design of their own programs; (4) stu- 
dents must participate in the design and development of the overall 
program; (5) there must be a mechanism, such as sponsorship, negotia- 
tion or performance contracting, for the personalization process; (6) 
students and staff attitudes must permit personalization; and (7) 
assessment must be consistent with personalization. 

25 

Besides the obvious interactions with program participants, it should 
be noted that persons responsible for ongoing program management may 
interact within the program (1) with persons in positions of. authority 
above them, (2) with persons in peer roles, and (3) with persons in 
subordinate roles. The major interpersonal interactions outside the 
program which appear pertinent include members of such groups as pro- 
fessionals in other fields and disciplines, government personnel, 
community leaders, and so forth. 

O 
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the direct resolution of a problem, but also include compensating for 
or tolerating a particular difficulty.) As can be seen in Table 1, 
discussion of ongoing management can be oriented around three topics 
(sub-sub-areas for instructional focus )--materials , methods, and 
behavior settings. This part of the outline, expanded to include key 
sub-facets of each of these topics, is presented in Table 3. Each of 
these sub-facets deserves extensive discussion. However, such dis- 
cussion is beyond the scope of this paper. It must suffice here simply 
to emphasize that such management requires capitalizing on what is 
known about learning, behavior, and instruction with specific reference 
to such matters as; (a) motivation, (b) attention, (c) performance and 
practice, (d) reinforcement, (e) interpersonal relationships, (f) 
growth and development, and (g) a particular curricular area (see 
Adelman, 1973a). 

Program Evaluation . Essentially, the model which we use as a basis for 
designing our evaluative efforts is an adapted version of Stake's (1967) 
model for evaluating educational programs. Elsewhere, I have summarized 
this model and have presented a conceptualization of the key factors and 
critical problems related to evaluating personnel preparation programs 
(Adelman, 1973a). 

Within the limitations set by the problems which permeate program 
evaluation efforts, any program should attempt to evaluate as wide a 
range of impact as possible using procedures and standards which allow 
for objective and generalizable conclusions. For example, a comprehen- 
sive evftluation might encon^ass an investigation of the program' s impact 



TABLE 3 



Outline of Areas for Instructional Focus with Specific 
Reference to the Ongoing Management of Program 
Activities (Derived to the Fourth Level) 



VII. Program Implementation 

D. Ongoing Management of Program 

1. Materials (medium - message) 

a. Display 

b. Distribution 

c. Special Techniques for Specific Materials 

2. Methods (Procedural Models - Activities - Techniques) 

a. Facilitating Activation of Participants 

b. Facilitating Focused Behavior 

c. Facilitating Initiation of Activity 

d. Facilitating Maintenance of Participation 

e. Facilitating Appropriate Communication between 
Participants Regarding Results 

f. Strengthening Preceding Learning and Performance 
Patterns 

3. Behavior Settings (Organizational Format - Type, Locale, 
and Scope - Climate) 

a. Authority Relationships 

b. Peer Relationships 

c. Intellectual Climate 

d. Emotional Climate 

e. Moral Climate 

f. Physical Environment 
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on (1) the participants y (2) the pupils who are served directly and 
indirectly as a result of the efforts of the program's participants and 
graduates, and (3) the field in general* The primary emphasis in such 
an evaluation should be om describing and judging the congruence between 
stated Instructional objectives and what is accomplished, but there also 
should be an investigation of possible major (positive and negative) side 
effects. 

To be more specific about the nature and scope of such evaluative 
efforts, an investigation of the program's impact might focus on: 

1) the participants with particular reference to (a) the acqui- 
sition of new competence (knowledge, skills, and attitudes), e«g«, new 
teaching procedures, and (b) the modification of existing competence, 
e.g., acceptance of personal responsibility for acquiring needed 
competence, involvement in the field; 

2) the pupils whom they serve with particular reference to (a) the 
remediation of underlying process deficits, interfering behaviors, or 
both, e.g., perceptual deficits, extreme withdrawal and passivity, (b) 
the acquisition of needed prerequisites, e.g., attending, listening, 
(c) achievement in basic school subjects, e.g., reading, language, 
mathematics, and (d) relevant other behaviors and attitudes, e.g., 
self -direction, self -evaluation, inter- student cooperation, interests , 
values, feelings toward school; 

3) the field with particular reference to (a) the number of 
professionals, paraprofessionals, and recruits who are influenced 
directly and indirectly^ (b) effects on specific school districts and 
communities which probably would not have occurred if the program did 
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not existi e.g. , changes in policies and practices related to classroom 
methods and materials, staffing, in-service training, and so forth 
which were facilitated by the program's staff, students, and/or gradu- 
ates, (c) effects on specific institutions of higher education, e.g., 
changes in policies and practices related to pre-'Service training, and 
(d) effects on educational thought in general, e.g., changes In concep- 
tualization regarding the purposes and processes of formal education. 

Some of the key steps in evaluating (and studying) educational 
programs are seen as follows: 

1) In studying or evaluating educational programs, it is impojrtant 
to start with a detailed understanding of the problem, hypotheses, 
evaluation need, etc. 

2) With a clear understanding of the "problem'' being addressed, it 
generally is possible to translate such a problem into a set of major 
questions which should be answered, e.g., How effective are teachers 

in a particular school with reference to teaching reading? Do kinder- 
garteners with perceptual-motor problems have more difficulty learning 
to read than those without such problems? 

3) As a first step in answering questions which have been formu- 
lated, it is necessary to specify the relevant descriptive data 
(intended and unanticipated outcome, transactional, and antecedent 
variables) which have a bearing on the questions (e.g., see Adelman 
[1973a] for a description of some key variables). 

4) After specifying the data, it is necessary to specify the 
procedures which can be used to gather such data. As a brief sunmary, 
it may be noted that pertinent data can be gathered by employing rating 

ERLC 
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5c:!^es (Likert and Guttman :ales), checklists, questionnaires, and 
surveys, objective and projective tests, essays, semantic dif ferentis.' , 
Q sorts, anecdotal recorui, systematic analyses of products and perfor- 
m-^nce^ systematic records of specific accomplishments, directly 
solicited evaluations, measures of elements of such constructs as 
anxiety, locus of control, independence and self-control, expectations 
and aspirations, and so forth. (Obviously, whenever possible, standar- 
dized procedures should be used* ) 

With reference to conceptualizing the potential measures which 
might be used, Popham (1971) has suggested the consideration of two 
dimensions: *'(1) the measurement stimulus situation and (2) the type 
of . . . response required." As he states, a response can be observed 
and measured under either natural (e.g., classroom social interactions) 
or manipulated (e.g., test situations) conditions, and such responses 
can be either a product (e.g., an essay) or direct behavior (e.g., 
reading aloud). With reference to the two types of responses, it 
should be emphasized that (a) products will be the result of selecting 
from alternatives (e.g., multiple choice questions) and/or the construc- 
tion of a response (e.g., an essay); (b) behavior can be recorded 
(visually and/or auditorily) for later analysis; (c) the focus may 
range from "molar" to "molecular" responses; and (d) the response may 
or may not be made anonymously. In addition, it may be noted that many 
measures have a "reactive" effect, and, therefore, unobtrusive measures 
should always be considered and given high priority. 



26The two most critical considerations with reference to the measures 
selected, of course, are the degree to which they can be used to produce 
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The types of people who can provide the desired data may range from 
individuals involved in a particular program to representatives of a 
variety of external interest groups, institutions, and agencies. The 
most likely sources are a program's students and instructional, 
administrative, and support staff; qualified, impartial individuals 
who are not affiliated with the program; members of policy making and 
other interest groups; relatives of students; and subsequent employers 
and colleagues. 

5) In addition to designating the procedures to be used In gather- 
ing the desired data, it also is necessary to specify the design to be 
used. In this connection, see Campbell and Stanley (1971) for 
discussion of pre-experimental , experimental, and quasi-experimental 
designs (e.g., the one shot case study, the one-group pretert-posttest 
design, the static group comparison, the pretest-posttest control 
group design, the posttest-only group design, the time-series experi- 
ment, counterbalanced designs). The design (and measures) chosen 
should be based, to a great extent, on decisions regarding the type 
of standards which one wants to use in judging the descriptive data 

which is to be gathered, e.g., whether the standards used are to be 

27 

relative (norm referenced) or absolute (criterion referenced).'^' 

reliable data (e.g., over time, over situations, between raters) and 
t\ie degree to which such data has validity (e.g., content validity, 
predictive validity). 

2^To clarify this point further, it may be noted that the nature and scope 
of the sample(s) ("responders'' ) are critical considerations, e.g., too 
small samples or non-representative saiiq)les can result in means and stan- 
dard deviations which are poor approximations of the parameters of popu- 
lations which are to be compared; the absence of appropriate comparison 
(control, contrast) groups can make it virtually impossible to use col- 
lected data to answer questions which may be of major concern; and so forth. 
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As the examples offered in this section suggest , programs which 
prepare educators can and should be evaluated on many levels. In 
addition, it should be evident that the concerns, issues, and problems 
related to evaluating personnel preparation programs in both general 
and special education are not substantively different and that the 
process of evaluating such programs is in its early developmental stages. 
In view of this state of affairs, I repeat and re-emphasize the point 
that, in determining whether satisfactory levels of competence have 
been att&ined to warrant certification, a reasonable strategy would 
seem to be that of evaluating at appropriate times complex, major 
behavioral outcomes, e.g., the instructional plan for a week, the 
installation of a new approach to reading instruction, a critique of 
a research article, and so forth. And in judging the adequacy of such 
behavior, it seems we will have to rely on a combination of expert 
judgement and relative comparisons (e.g., among program participants) 
until we finally establish, empirically, some appropriate standards. 

More generally, I would suggest that until there is a more defini- 
tive body of knowledge in the field and further development with 
reference to the processes by wh'ch we prepare professionals and eval- 
uate such preparation, it seems unlikely that personnel preparation 
programs can be evaluated very satisfactorily. Nevertheless, such 
programs must be evaluated, and those responsible for the programs 
should be held accountable. However, the term accountability must not be 
interpreted simplistically. At this time^ appropriate program evalua- 
tion in special education requires more than the systematic collection 
of immediate achievement and cost accounting data* In particular^ it 
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Is felt that programs which prepare personnel such as change agents 
should be evaluated conprehenslvely in terms of their general contribu* 
tlon to current educational services, training, and research , rather 
than in terms of such narrow criteria as pupil achievement in the 
"3 R's" or per capita cost with reference to immediate pupil benefits. 
Clearly, therG is a great deal which still must be learned about 
educating exceptional individuals, preparing professionals, and 
evaluating educational programs; we cannot afford to ignore the inq^li- 

cations of thes<2 needs in the rush to establish strategies for 

28 

accountability. 



^^See Adelman (1973a) for a general discussion of personnel certification. 
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Appendix A 

Brief Summary of Expert Views Regarding Change Agent 
Characteristics, Attitudes, Knowledge, and Skills 

Descriptions of what constitutes an effective change agent range 
from statements which emphasize individual change agent styles to a 
specification of attributes which sound saint-like. This phenomenon 
appears to occur whenever experts attempt to describe education pro- 
fessionals, be it a description of a classroom teacher or a school 
district superintendent. In reading the followir.g statements regarding 
change agents, readers should ask themselves: Is the statement unique 
to change agents or is it shared by other educational professionals, 
e.g., classroom teachers? 

Rogers and Shoemaker (1971) list a number of positive attributes 
related to change agent effectiveness derived from tbs research litera- 
ture, i.e., effective change agents expend extensive effort, are 
perceived by clients as being empathetic, credible, and as having higher 
social status; in addition, they have a higher degree of education and 
literacy, a cosmopolite orientation (characterized by gregariousneLis 
and fairly extensive contacts with persons and organizations extrinsic 
to one's current role and work setting), and have a homophily with 
clients (defined by Rogers as "the degree to which pairs of Individuals 
who interact are similar in certain attributes-'). Havelock and Havelock 
(1973) report that the experts who attended the Michigan Conference on 
Educational Change Agent Training suggested some of the following 
attitudes, knowledge and skills: 



1) Attitudes 
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"Primary concern for benefit of the ultimate user (usuall 
. students and communities in the case of education). 
Primary concern for benefit of society as a whole. 
Respect for strongly-held values of others. 
Belief that change should provide the greatest good to 

the greatest number. 
Belief that changecs have a need and a right to under- 
stand why changes are being made (rationale) and to 
participate in choosing among alternative change means 
and ends, 

A strong sense of his own identity and his own power 
to help others, 

A strong concern for helping without hurting, for 

helping with minimum jeopardy to the long- or short- 
term well-being of society as a whole and/or specific 
individuals within it. 

Respect for existing institutions as reflections of 

legitimate concerns of people for life space boundaries 
security, and extension of identity beyond the solitary 
self," 

2) Knowledge 

"Ihat individuals, groups, and societies are open inter- 
relating systems. 

How hi5 role fits into a larger social context of change. 

Alternative conceptions of his own role now and his 
potential role in the future. 

How others will see his role. 

The range of human needs, their inter-relationships and 
probable priority ranking at different stages in 
the life cycle, ^ 

llie resource universe and the means of access to it. 

The value bases of different subsystems in the macro- 
system of education. 

The motivational bases of different subsystems in the 
macrosystem. 

Why people and systems change and resist change. 
How people and systems change and resist change. 
The knowledge, attitudes, and skills required of a 
change agent. 

The knowledge, attitudes, and skills required of an 
effective user of resources," 

3) Skills 

"How to build and maintain change project relationships 
with others. 
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How to bring people to a conception of their priority 

needs in relation to priority needs of others. 
How to resolve misunderstandings and conflicts. 
How to build value bridges. 

How to convey to others a feeling of power to bring 

about change. 
How to build collaborative teams for change. 
How to organize and execute successful change projects . . 
How to convey to others the knowledge, values, and skills 

he possesses. 
How to bring people to a realization of their own 

resource-giving potential. 
How to expand people's openness to use of resources, 

internal and external. 
How to expand awareness of the resource universe. 
How to work collaboratively (synergistically) with 

other resource systems. 
How to relate effectively to powerful individuals and 

groups. 

How to relate effectively to individuals and groups 
who have a strong sense of powerlessness. 

How to make systemic diagnoses of client systems and 
how to generate self -diagnosis by clients.'* 

As Havelock s"^d Hp- ock (1973) indicate, these lists are 
"too genera? Lu constitvce behaviorally specific outcomes." 
Nj'^ ^*;heless, such lists may be helpful in various facets of 
program development. 

Before concluding, it should be noted that most of the 
knowledge, skills, and attitudes listed could be grouped under 
three categories of functions which are the concern of most 
education professionals, namely, efforts to systematically plan, 
implement, and evaluate programs for (1) direct service, (2) 
training, and (3) advancement of the field. (A few of the listed 
items simply are ''tools** needed for learning and daily functioning.) 
As I have suggested elsewhere, there is a great commonality of needs 
among various educational professionals (Adelman, 1973). 
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Appendix B 
Materials from the Pilot Program 

1. Five Areas of Instructional Concern — An Outline 

2. A Pragmatic List of Intended Instructional Outcomes 

3. Kandout--Introduction to the Program 

4. Expanded Outline Plan for Research Area 

5. M.A. Comprehensive Questions 



1. 



Five Areas of Instructional Concern 



DEFINITIONS, LONG RANGE GOALS AND GENERAL ABILITIES 

Assessment 

I. Definition 

Assessment may be viewed as a process by which an individual atteiq)ts 
to understand himself and other individuals in order to describe, 
predict, explain, and make decisions* 
II, Long- Range Goal 

The individual should develop an understanding of the uses, limi- 
tations, and abuses of assessment, including the ability to employ 
and interpret relevant formal and informal assessment procedures 
and to derive implications from assessments made by others. 
III. General Abilities 

Observational and "testing" ability 

(i.e., knowledge regarding the importance of and how to gather, 
systematically and in situ , information relevant to one's own 
effectiveness and to a particular pupil's general behavior and 
academic functioning)** 
Interpretative ability 

(i«e«, knowledge regarding how to analyze and evaluate 
systematically the meaning of observational and test data)*** 

*The reason for learning to be able to derive implications from assess- 
ments made by others is that many school counselors, psychologists, and 
physicians report findings without clarifying the implications for school 
practices. Therefore, every professional educator should be equipped to 
interpret some of these findings even though he may not have been taught 
ho\/ to administer a particular assessment procedure, e.g. , intelligence 
tests. It is recognized,, of course, that some procedures are only 
appropriately interpreted by the professionals who administer them. 

**Such ability should include the conq>etencies required for determining 
(a) the appropriate level for instructional focus — i.e., whether the focus 
is to be on basic school subjects, prerequisites to school learning, 
pathological behaviors, and/or underlying process deficits, (b) what 
specifically should be taught at that level, and (c) what out-of-the- 
classroom steps should be taken to facilitate learning and performance. 

***The instructional implications one derives from such data are dependent, 
of course, on one's knowledge of what is involved in school-related 
learning and performance, e.g., understanding the prerequisites a 
youngster must acquire before he can function effectively in learning a 
particular school subject. 



Program Planning and Implementation 

I. Definition 

Program planning and Implementation may be viewed as a process by 
Which an Individual purposlvely and appropriately utilizes available 
resources* especially people and materials ' 
II, Long- Range Goal 

The individual should develop the ability to formulate, initiate, 
and/or participate in activities, in and out of the school setting, 
which purposlvely and appropriately facilitate learning for each pupil 
III. General Abiliti€.:i 

Basic instructional ability 

(i.e., ki'owledge regarding the importance of and how to person- 
alize cl.dssroom instruction to allow for the wide range of 
developmental, motivational, and performance differences which 
exist in every classroom)* 
Curriculum ability 

(i.e./, knowledge regarding the importance of and how to develop, 
select, adapt, apply, and evaluate the. impact and role of 
methods and materials which are relevant to mastery of basic 
leatning and perfomAice skills and for sensory, percepr::ual, 
ro^^toric, cognitive, language, social, and emotional growth 
ufti: . development) 
Classroori management ability 

(i.e., knowledge regarding the importance of and how to structure 
a classroom of students in a way which is compatible [does not 
conflict] with ::'ie fostering of each youngster's desire and abil- 
ity to learn and perform and the ability to detect current and 
potential behavior problems and correct, compensate for, and/or 
tolerate such deviations) 
Interpersonal abil ity 

(i.e., knowledge regarding the importance of and how to interact: 
effectively wl.b pertinent others, both in and out of school) 
Self-corrective abi ity 

(i.e., knowlGage regarding the importance of and how to gather 
and utilize evaluate feedback assessment information to enhance 
personal and professional effectiveness) 

*The focus here is both on the competencies needed for dealing with the 
majority population and those required for coping with "exceptional" 
individuals. 

**Besides the obvious interactions with pupils, the interpersonal 
interactions within the school system may be viewed as occurring on 
three levels, i.e., interactions between an individual and (1) those 
who are in positions above him (e.g., supervisors, administrators), 
(2) those in positions comparable to his (e.g., other teachers, coun- 
selors, consultants), and (3) those who are in training or have 
paraprofessional positions (e.g., aides). The major interpersonal 
interactions outside the school system which are involved directly 
with instruction, of course, are seen as centering around family 
members and other professionals (e.g., physicians, psychologists). 
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Consultation 

I. Definition 

Consultation may be viewed as a process by which an Individual 
attempts to assist a colleague's efforts to assess and solve a 
problem purposlvely and appropriately 
II. long-Range Goal 

•'ne Individual should Increase his breadth and depth of knowledge 
and skill with reference to assessment and program planning and 
Implementation* 
III. General Abilities 

No substantively new abilities are needed--only an Increase In the 
level of competence In areas already listed 

*Success In this area Is positively correlated with the individual's . 
depth and breadth of knowledge and skill in these areas, especially 
with reference to interpersonal ability since the consultant must be 
able to Interact in a nonthreatening, task-oriented, and task-productive 
manner. 



Supervision 

I, Definition 

Supervision may be viewed as a process by which an individual 
critically analyzes, evaluates, and guides programs and personnel 
in order to facilitate the improvement of the programs for which 
he is responsible 
II. Long-Range Goal 

The individual should increase his breadth and depth of knowledge 
and skill in the areas of assessment, program planning, and 
consultation. (Some supervisory positions require administrative 
functions, in such instances, programs should allow for the develop- 
ment of such skills) 
III. General Abilities 

No substantively new abilities are needed--only an ItAcrease in the 
level of competence in areas already listed (except in those in- 
stances where specific administrative duties such as budget prepar- 
ation, are part of the supervisor's functions) 

Research 

I. Definition 

Research may be viewed as a process by which new facts are discovered 
and accepted conclusions are supported, rejected, and/or revised 
II, Long-Range Goals 

The individual should develop the ability to be a critical consumer 
and a responsible and effective producer of research 
III. General Abilities 
Consumer ability 

(i.e., knowledge regarding the Importance of and how to evaluate 

research findings which have implications for one's work) 
Participant ability 

(i.e., knowledge regarding the lnq)ortance of and how to assist 

and/or initiate school-related studies) 
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A Pragmatic List of Intended Instructional Outcomes 

Each of the outcomes listed below was formulated to facilitate 
our efforts directed at (1) specifying the set of related observables 
encompassed by our g;oal-constructs and (2) grouping sub-sets which are 
appropriate instructhlonal objectives. Thus, their wording is more 
reflective of the pragmatic use for which they were developed than of the 
type of conceptual* mbdel we are trying to evolve^ 

The intention 6f the program is to facilitate the acquisition by 
each program participant of the following: 

I. The ability to verbalize in a systematic and conceptual manner 

a) basic concerns confronting the field of education, 

b) the special task of special education, 

c) various causes and correlates of school learning problems, 

d) the sub-steps involved in the process of planning, iiiplementing, 
and evaluating (including assessment) the various types of 
educational programs ;1 

e) similarities and differences in the processes of planning, 
iuiplementing, and evaluating the various types of educational 
programs; 

f) major issues and problems related to planning, implementing, 
and evaluating the various types of educational programs; 

g) a general process by which one can evaluate critically the 
literature which has implications for the education of pupils 
and education personnel; 

h) additional considerations which must be understood if one is 
to evaluate critically: 

1. an article reporting findings and implications of a 
research study; 

2. an article reviewing the research literature in a given 
area; 

3. a theoretical or conceptual article; 

4. a polemic on the state of the field; 

5. an article dealing with learning disabled pupils, 

i) the importance of program planning and program evaluation and 
of research in education* 

II. The ability to: and III. The desire to: 

a) plan, in?>lement, and evaluate (including assessment) classroom 
instructional programs for pupils not only in the general popu- 
lation, but for pupils who manifest learning/behavior problems; 



^For our purposes, educational programs « (1) school programs for the 
general population and for the population of pupils with learning/behavior 
problems; and (2) preparation programs for education personnel* 
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b) plan, implement, and evaluate a program for preparing education 
personnel to impact not only on pupils In the general population, 
but also on pupils who manifest learning/behavior problems; 

c) find and utilize relevant writings (research, etc.) which have 
implications for one's work; 

d) participate in school-related empirical investigations. 
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Introduction to the Program 

This is the beginning of our experimental Master's degree program 
which will employ a non- traditional model of training and will prepare 
personnel who are equipped not only to provide direct services for 
pupils, but who also are able to assume a leadership role with reference 
to pre- and in-service teacher education. In this connection, program 
participants will learn innovative classroom practices, as well as 
innovative approaches for teaching such practices to teachers in the . 
field and to prospective teachers. A particular emphasis in the program 
will be on practices which enable teachers to provide effective programs 
for pupils with learning and behavior problems. 

This program is particularly well-suited to prepare personnel for 
the District's proposed experimental in-service program which would 
be implemented during the academic year 1972-73. This program would 
employ teachers who have been specially trained to assume a leadership 
role in the in-service education of other teachers. While the initiation 
of the new program is not certain at this time, the District is proceeding 
under the assumption that it will be implemented. It is clear, however, 
that even if the program is not initiated, those teachers who success- 
fully complete the year of training will have benefited both by 
improving their level of teaching competency and by the acquisition of 
a Master's degree. 

On the following pages are some notes which have resulted from our 
planning sessions to date. It should be emphasized, however, that this 
will be a year of experimentation (innovation, trial and error). Nothing 
that we have planned Xo date is sacrosanct. We will all be working 
together to plan, develop, implement, and evaluate a program which can 
serve as a model for others. We can anticipate some problems in the 
process, but, hopefully, the rewards will far exceed the frustrations. 
We have the unique and exciting opportunity to develop something new and 
important; our success or failure is dependent only on our own desire, 
energy and goodwill. 



I, Assessment 

Long-Range Goa y—C^n effectively and efficiently collect and interpret 
information about children in order to modify or develop programs 
and procedure., 
Primary Compet(rncies 

I. Can assess individual and group needs, interests, etc. 
II. Can verbalise the importance (uses, limitations ^nd abuses) 
of assessment. 

III. Can assess impact of program with a view to planning change. 
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Focusing Questions 

1. What is assessment? 

2. Why do any assessment at all? 

3. If I am doing assessment, what do I want to know? 

4. How can I find it out? 

5. What information do I already have? 

6. Is what I found by assessing valid? 

7. What are the most economical and accurate ways to assess? 

8. Did I need the information? Was the assessment meaningful? 

9. What is the relationship between assessment and evaluation? 

II. Program Planning and Implementation 

Long- Range Goal — Can effect positive changes in classrooms as measured 

by attitudinal and achievement changes in learner (s). 
Primary Competencies 

I. Can effectively aid individual and group in selection/prescrip- 
tion of programs for study. 
II. Can effectively implement programs planned for groups and 
individuals. 

III. Following the implementation of the program, can effectively 
plan and implement needed change, based on assessment of 
feedback. 
Focusing Questions 

1. How does your assessment, information affect your program planning? 

2. What constitutes a program? 

3. What makes a program successful or unsuccessful? 

4. How do you plan a program? 

III. Consultation and Supervision 

Long- Range Goal — Can communicate effectively with people about problems 
and help them learn to solve those problems.* 

(^Problem = Increasing the educational opportunity for 
individual children.) 
Primary Competencies 

I. Awareness of Self. 

A. Understand one's underlying personal (internal) motivations. 

B. To know how one is perceived by others. 

C. To know strengths and weaknesses and limitations. 

D. Ability to self-evaluate. 
II. Awareness of others. 

A. Ability to tell what message has been received by another. 

B. Sensitivity to needs of others — be able to know him 
personally and professionally. 

III. Program Planning and Implementation as related to Consultation. 

A. Can participate in and facilitate group processes (particular- 
ly in relation to school related issues). 

B. Can learn a new practice, implement it, and teach others to 
use it. 

C. Knows a variety of solutions to problems (can verbalize) and 
how to implement them. 
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Can verbalize the di8?:inction between consultation and 
supervision. 
Focusing Questions 

1. What allows a consultant to be effective? 

2. Can you train a person to be a consultant? 

3. What allows (and encourages) a consultant to continue to be 
effective after initial encounters? \ 

IV. Research 

Lonfg-Range Goal --The individual will develop the ability to be a critical 
consumer and a responsible and effective producer of research. 
( The focus will be on any relevant literature which has . 
iiiq>llcations for one's wprk; a major focus, however will be on 
•empirical articles.) 
Primary Competencies 

I. Consumer Ability. 

A. Can verbalize the importance of research to the field of 
education. 

B. Can evaluate research reports which have implications for 
his work. 

C. Can find and utilize research reports which have implica- 
tions for his work. 

D. Wants to find and utilize research reports which have 
implications for his work. 

II. Participant Ability. 

A. Can verbalize the importance of assisting in school-related 
studies (especially program evaluation). 

B. Is able to participate in school-related studies (especially 
program evaluation). 

C. Does participate in school -re la ted studies (especially 
program evaluation). 

D. Wants to participate in such studies. 

**E. Is able to initiate school-related studies. 
**F. Does initiate school-related studies. 
**G. Wants to initiate school-related studies. 

(**Not an objective of the current pre-servtce program.) 
Focusing Questions 

1. Cochran, Hosteller, and Tukey (1954) ask: "If we admit the 
presence of systematic errors (in measurement and sampling) 
in essentially every case, what then distinguishes good 
Inquiry from bad? 

2. In reading a report of research, what does one need to know in 
order to determine whether the results and implications are 
reliable and valid? 

3. Wliat factors should be taken into account in evaluating 
educational programs and what problems arise? 
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Expanded Outline Plan for Research Area 

Long'^Range Goal --the individual will develop the ability to be a 
critical consumer and a responsible and effective producer of research, ^ 

Primary Competencies 

A, Consumer Ability 

1. can verbalize the importance of research to the field of 
education 

2. can evaluate resei.rch reports which have implications for 
his work 

3. can find and utilize research reports which have implica- 
tions for his work 

4. wants to find and utilize research reports which have 
implications for his work 

B, Participant Ability 

1, can verbalize the importance of assisting in school-related 
studies (especially program evaluation) 

2. is able to participate in school-related studies (especially 
program evaluation) 

3, does p articipate in school-related studies (especially 
y program evaluation) 

4. wants to participate in such studies 

*5. is able to initiate school-related studies 
*6. does initiate school-related studies 
*7. wants to initiate school related studies 

(■sfcNot an objective of the current pre-service program) 

Focusing Questions 

1, Cochran, Hosteller, and Tukey (1954) ask: "If we admit the presence 
of systematic errors (in measurement and sampling) in essentially every 
case, what then distinguishes good inquiry from bad? 

2, In reading a report of research, what does one need to know in order 
to determine whether the results and inq)lications are reliable and valid? 

3, What factors should be taken into account in evaluating educational 
programs and what problems arise? 

a. Content and concepts 

To be an intelligent consumer, the teacher should know certain ideas 
reliited to (1) design, (2) measurement, (3) analysis, and (4) interpretation. 



^The focus will be on any relevant literature which has implications for 
one's work; a major focus, however,, will be on empirical articles. 



B-12 



and should know the variables and problems associated with (5) program 
evaluation* 

1) Design 

A) Internal validity 

(1) history and maturation 

(2) testing effects 

(3) instrumentation 

(4) statistical regression 

(5) experimental mortality 

(6) selection-maturation 
interaction 



B) External validity 

(1) reactive or interactive 
effect of testing 
interaction effects of 
selection biases and the 
experimental variables 
reactive effects of 
experimental arrangements 
(4) multiple treatment interference 



(2) 



(3) 



(A handout needs to be developed to clarify each of the above; it should 
be noted that the above ideas enconq>ass problems related to san^)ling, 
appropriate comparisons, calibration of a measuring instrument, Hawthorne 
and halo effects, and changes in observers' scores) 

The above conceptualization is from: 

Campbell and Fiske, Experimental and quasi-experimental designs for 
research pp. 5-6 

An easier to read discussion of design is found in: 

Skager and Weinberg, Fundamentals of educational research pp. 77-89 



2) Measurement 

A) The need for measurement (Why measure?) 

B) Measurement procedures (How things are 

measured? 



(points to be discussed) 
Progress and 
accountability. 
Tests J questionnaires, 
interviews. 



C) Bteliability and validity 



Reliability concerns 
the congruence among 
responses measured 
under maximally 
similar stimulus 
conditions, Val idity, 
£n contradiction to 
reliability, requires 
convergence between 
responses to maximally 
different, independent 
stimulus conditions 
or measures. 

Again, Skager and Weinstein's book is a helpful resource--see ch, 5 pp, 101-125. 



D] Problems related to measurement 



3) Analysis 

A) Measures of central tendency 

B) Measures of dispersion or 
variability 



(points to be discussed) 
mode, median, mean, 
range, standard 
deviation. 
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C) Correlation and prediction 
(How well do they go together?) 

D) Significance of differences 
(How different are they?) 

E) Percentile 



relationships, and 
cause and effect. 

t - XI . X2 



pooled 
variability 
(noise) 



The above can be found In most basic texts in educational psychology, 
measurement, research, and so forth. Some of this is in Skager and 
Weinberg, pp. 89-98. Another helpful source is Wilson, Robeck, and 
Michael J Psychological Foundations of Learning and Teaching . Part VI 
(Measurement and Evaluation). 

4) Interpretation/ inferences 

A) Reliability 

B) Internal and external validity 

C) Meaningfulness and/or appropriateness of question or 
problem area 

D) Justifiability of conclusions and implications 

E) Alternative conclusions and implications 



5) Evaluation 

A) A model of evaluation 



B) Problems related to e\'aluatlon 



Stake's model (also might 
look at Metfessel and Michael 
paradigm [pp. 462-463] in 
Wilson, Robeck, &. Michael). 
Adelman's article. 



b. Skills and Behaviors 



1) Reading and interpreting tables and graphs 

Covered in Wallls and Roberts pp. 270-79. Also in Research 
Methods: Readings pp. 418- 



c. Awareness and attitudes 

1) other evaluation models see Popham-Stake 

2) AERA and other relevant associations 

3) Library resources, pertinent journals, partly covered by Skager 
reviews and Weinberg* 

4) Sources of financial support 

5) Research and humanistic goals 



EXPERIENCES 

1) Read (buy Skager & Weinberg or comparable resource--HANDOUTS, library) 

2) Discuss in class (lecture, questions and answers — Ted Nickel, guest) 

3) Discuss with each other 
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4) Apply to an article (sometimes self-chosen--ln which case emphasis Is 
on finding resources which have implications for one's work-- 
sometlmes assigned) 

(The pattern and sequence would be (a) read and discuss design 
concepts during a particular week, then (b) apply these concepts 
over the next week or two, then Introduce measurement concepts, 
repeating pattern, and so forth) 
Spirrling through the year they 

v 111 be participating in the program evaluation (and this can be used 
-as a point of focus in learning about evaluation) 
) can, if they desire, participate in a research study. 



PROGRAM EVALUATION 



1) Critique an article pre- and post 

2) include relevant items on questionnaires (including rating scales) 

3) maybe test (e*g», a comprehensive question) 



M.A, Comprehensive Questions 



These questions were formulated specifically to meet the needs of thi 
year's program. Each participant must pass the written comprehensives 
to qualify for the M.A. degree according to university regulations. 
Besides meeting university requirements, the responses were useful 
products demonstrating the participants' verbal competence, 

COMPREHENSIVE QUESTIONS 
I, Questions on program planning^ implementation^ and evaluation 

1. Describe in a systematic and conceptual manner, the process of 
planning, implementing, and evaluating a program of classroom 
instruction and then list and discuss the major issues add problems 
related to such ptogram planning, implementation, and evaluation, 
(Be certain to discuss the role of assessment in this process.) 

2. According to Popham and Baker in their book. Systematic Instruction , 
the difference between the kinds of objectives that educators 
developed in the past and those that they are now being urged to 
develop is tha:f: in the past the objectives were so general as to 
provide "no explicit guidance for the teacher, either with respect 
to the selection of instructional sequences or to the evaluation of 
these Sequences." These writers feel that: "In order to provide 
such guidance, it is necessary for the profesaicnal teacher to 
describe his objectives ir* terms of measurable learner behaviors-- 
that is, in terms of what the learner can do or how he will act at 
the conclusion of instruction. Objectives stated in this way will 
leave little doubt about what the teacher's instructional intentions 
are." 

Defend or argue against this view and then discuss the impli« 
cations of the position you have taken for the processes of (a) 
planning a program of classroom instruction, (b) pre-ins tructional 
pupil assessment, (c) program iii5>lementation, and (d) program 
evaluation. (Be certain you don't think strictly in terms of 
instruction with reference to the cognitive domain. ) 

3. You are assigned to te&oh a sixth grade class next year: 

(a) describe what some of the major instructional objectives should 
be in the area of reading (i.e. , describe the intended outcomes of 
your program); 

(b) explain the rationale which provided the basis for choosing these 
particular^ objectives (instead of some others) and why you have 
stated them as you have; 

(c) describe wha^ should be done to accomplish these objectives and 
explain why (i.e. , indicate the types of learning activities the 
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pupils would experience, the procedures which would be used for pupil 
assessment and for pupil and program evaluation); 

(d) describe how such a program will acconimodatc pupils who manifest 
school learning problems, (Even if you have already made reference 
to thils matter, respond here.) 

II, Questions on supervision and consultation 

1, Describe in a systematic and conceptual manner, the similarities and 
differences in the processes of planning, iiiplementing, and evaluating 
(a) a teacher education program and (b) a public school classroom 
program. List and then discuss the major issues and problems which 
are encountered in planning, inplementing, and evaluating a teacher 
education program, 

2, According to Sarason in his book. The Culture of the School and the 
Problem of Change , "Good ideas and missionary zeal are sometimes 
enough to change the thinking and actions of individuals; they are 
rarely, if ever, effective in changing complicated organizations 
(like the school) with traditions, dynamics, and goals of their own. 
To change complicated settings requires, initially at least, a 

way of thinking not the same as the way we think about changing 
individuals." 

Defend or argue against this view and then discuss the impli- 
cations of the position you have taken for the process of introducing 
major programmatic changes into a school district, 

3, You have been employed as a "change agent" by a school district. 
The superintendent indicates that he has been very impressed by the 
social studies program at "In5)ressive Elementary School." He assigns 
you the tafik of finding a way by which other schools in the district 
will change their social studies programs so that they are effectively 
offering a social studies program based on the one at "Impressive 
Elementary School." - ► . 

(a) Describe the way a change agent should go about implementing 
and evaluating a program which will result in such changes. 

(b) Explain the rationale which provided the basis for choosing 
these particular procedures instead of others. 

(c) What types of problems should a change agent anticipate 
encountering and how will the procedures you have described above 
help to overcome such problems? 

Ill, Questions related to critical reading of the education literature 
(especially research) 

1, With reference to the literature which has implications for the 
education of pupils and teachers, describe in a systematic and 
conceptual manner the general process by which one can evaluate 
critically what one reads. Then, clarify any additional problems 
which must be considered if one is to evaluate critically: 

(a) an article reporting the findings and implications of a 
research study; 

(b) an article reviewing the research literature in a given area 
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(c) a t:heoretlcal or conceptual article; 

(d) a polemic on the state of the field; 

(e) an article dealing with learning disabled pupils* 

2, Cochran, Hosteller, and Tukey (1954) in "Principles of Sain>ling",^ 
Journal of the American Statistical Association , 49, 30-35, 1954, 
ask: "If we admit the presence of sy/itematic errors (in measure- 
ment and sanqpling) in essentially every case, what then distin- 
guishes good inquiry from bad?" 

Answer this question and discuss what your answer suggests 
with reference to the use of ideas and conclusions derived from 
much of the literature which is meant to have in^lications for the 
education of pupils and teachers. 

3. Read and critically evaluate the following article. * (To be supplied 
at the time of the exam.) 



^Reprinted in Franklin and Osborne, Research Methods: Issues and 
Insights . Wadsworth Publishing Co., 1971. 



Appendix C 

An Abstract of "Alternative Training Models," Part Two in 
R.G. Havelock and M.C. Havelock, Training for Change Agents ,^ 

As part of the Michigan Conference on Educational Change Agent 
Training, a number of alternative models of training for different 
concepts of ''change agent" were delineated. Ten task force reports 
were produced and are grouped into four general categories of programs: 

(1) programs to train school systems to develop a self-renewal capacity, 

(2) programs for change agent linkage of school systems to resources, 

(3) programs to effect political and structural changes in school 
systems, and (4) programs to improve the effectiveness of: other 
educational agencies. In addition to the ten reports, the Havelock^ s 
present e more detailed model for training change agents in state educa- 
tion agencies. 

. The general framework provided for the delineation of the various 
models emphasized seven key design elements. 

1. "define the change agent role and provide a rationale" 

2. "preconditions for selection and training" 

3. "outputs from training: knowledge and skills" 

4. "ways to provide required training (e.g., timing, 

scheduling, types of materials, types of experiences)" 

5. "criteria for success in the role" 

6. "evaluation process" 

7. "how to set the role in an institutional context." 

No effort is made here to abstract what is said with reference to each of 
the above design elements. Rather, the Intent is to highlight the type 
of personnel to be trained and their functions. 

^Published by the Center for Research on Utilization of Scientific 
knowledge. Institute for Social Research, University of Michigan, 1973. 
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Four General Categories of Models 

I. Self-Renewal within the School System 

Four reports are grouped under this ca';;egory: 

A. Edward Glaser and Max Goodson focus on ^'The Schocl-Comraanlty 
Resource Team" and emphasize the training of a Research Utilltzation 
Specialist (RUS) to help school systems develop skills and mechanisms 

for change programs including the training of a team of key school 
personnel and community leaders to manage future change programs. Such 
a RUS is viewed as being a catalyst, process helper, knowledge linker, 
and adaptation- implementation helper* 

B. Eouglas Townc focuses on "The Knowledge Utilization 
Function/ Role" and also emphasizes the training of a Research Utiliza- 
tion Specialist (RUS) as tho. knowledge linker between resources and 
school system users who help all school system personnel with knowledge 
utilization. It should be noted that ultimately Towne wants all 
educational* perso^meL to be trained in knowledfz^e utilization during the 
pre-service preparation program. 

€• Paul Hood, Russell Kent, Donald Johnson, Louis Haguire, 
and Joe Ward focus on a "Minimal Training System for Self- Renewing 
Schools" and emphasize training all school personnel rather than a 
change agent. 

D. Garry Ualz, George Sproulc, Marlenc ?r ingle, and Jane 
Skinner focus on an "Integrated Model of Counselor Behavior" and 
emphasize the training of counselors in various settings to help schools 
and students by conducting system and individual diagnoses, conducting 
performance appraisals, advocating and initiating change and intervention. 
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providing linkages with resources, and conducting evaluations of their 
own role performance. 

II. Linking Schools to Outside Resources 

I^iTO reports are grouped under this category: 

A. William Wolf focuses on **The Knowledge Utilization 
Specialist Team. and Leader" and emphasizes the training of such a team 
and leader to help local education ageiicies and institutions of higher 
education within a specified region (a la the county agriculture agent) 
by generating owaren/rtsa of knowledge resources, communication channels, 
and client needs and helping to translate such awareness into action. 
The team leader is seen as being a staff member of the State Department 

of Education with knowledge of national and statewide agencies, resources, 
and power structures; the team members would focus more on local matters. 

B. Betty Ellis, Elliot Spack, Charles Chandler, and James 
Beaird focus on "Teacher Trainers" and emphasize the training of a cadre 
of teachers (presumedly coordinated and directed by the State Department 
of Education to help practicing teachers by providing linkage with 
resources, diagnosis of the system, and support for those who are 
adopting/adapting innovations. 

III. Effecting iBolitlcal and Structural ^ange in Schools 
Tw reports are grouped under this category: 

A. Kenneth Tye focuses on "The Political Linkage Agent" and 
emphasises the training of such %n agent to help equalize power in the 
school between the political system (administration and board of educa* 
tlon) and user groiq>s (coamunity, teachers, and students) by acting as a 
process helper, catalyst^ and solution giver. 
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B. Mark Chesler, Arthur Chick^^rlng, Per Dalin, Dale Lake, 

Matthew Miles, Everett Rogers, and Lucille Schaible focus on a 
••Change-Through-Crisis Moder^ and emphasize the training of individuals 
within the system to fill two types of change agent roles. They suggest 
a training team come to a system (school) in crisis, identity individuals 
who have provided leadership in past crises, and train them to be more 
effective. One type of change agent to be trained is an Advocator- 
Organizer-Agitator who would help define the systems problems. The 
second type of change agent to be trained is a Social Architect who is 
to help restructure the school system so that the defined problems can 
be solved* 

IV. Changing the Larger System 

IWo reports are grouped under this category: 

A. Kenneth Benne, David Bushnell, Norman Hearn, Edwin 
Hildebrand, Norman Kurland, and Robert Neiman focus on a ••Macrosystems^^ 
model and emphasize the training of "Interface Agents^*' to* help improve 
the relationship between two systems jointly involved in educational 
change (e.g., USOE and State Departments of Education). The agents 
would be a team chosen either from within both systems or from oateide 
sources; they would help resolve conflicts, assist in goal setting and 
resource ut ilitzation, and attempt to improve on-going inter-system 
relationships. 

B. Irving Millgate and Ronald Lippitt focu£ on a ••Proposed 
Approach to Solve DilenBia'^ and emphasize ••a program to inprove the 
quality of the 'delivery* of services by the State Department of 
Education to local school systems.*' No change agent is trained. '•All 
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personnel in the department work to: (1) Identify quality services, 
(2) set goal images, (3) diagnose department problems, and (4) iiiq>lement 
improvement alternatives* 



"Sample Model of a Fully Developed Training Design" (Havelock and Havelock) 

The model described was designed as a pilot program "to train and 
install a samll number of state education agency consultants as full 
time professional change agents* The program was conceived as a 10-day 
training sequence distributed over a one-year period with intervening 
reading and writing assignments . and several types of on-the-job 
practice* • • • the program singles out particular individuals in a 
strategic location, the state fi^ducation agency, as the 'change agents* 
who will becotoc, over time, a core training staff for the agency and 
for the state system as a whole. I^n this sense, therefore, the proposed 
program is not the training of change 'agents' as much as it is for the 
training of trainers in change planning and managing skills." - 
"The program description is outlined as follows: 

1. The Rcle 

a. Title 

b. Definition and General Descriptioc^ 
c* Rationale 

d. Limiting Assumptions 

2. Trainee Candidate Qualifications for Participation 
3* Anticipated Outcomes of Training 

a. Attitudes 

b. Knowledge 

c. Skills 

4» The Training Procedure, including: 

a. Schedule 

b. Trainer and Trainee Preparation 
€• iaadings 

Outline Descriptions of Training Units 
5* Guidelines for Installation of Tralnl^es in State Agency Positions 
6, Suggested grlterla for Evaluating 
a. Training Traasfer Effectiveness 
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b. Role Installation Effectiveness 

c. Long-Term Benefit to Education 

7. Suggested Alternative Procedures for Evaluating Training 

8. Suggested Procedures for the Feedback and Utilization of 
Evaluative Data, so that the program can be systematically 
redesigned and inqproved from year to year." 

A discussion of each of the above points is beyond the scope of 

this abstract; however, the features of the oection on the training 

procedure sh-*>uld be noted. The training section encompasses: 

a) a discussion of the schedule for the three training workshops 
held during the year and the in-between planning and In-service activities, 

b) the basic reading list (annotated) for the program as a whole, 

c) trainer and trainee workshop preparation checklists, 

d) a discussion of the t::ainee notebook, 

e) outline descriptions of the 12 units, including time alloca- 
tions and activity specifications, e.g.,, specific descriptions of: 
assigned readings, lecture and discussion topics, written exercises, 
dyadic, triadic, and large group sharing and role playing, skill 
building exercises, case simulation exercises, films ^ directed discussion 
and posting. 

**What Oianje Agents Should Know About Professional Assoclaticns" 

Sidney Loros* report is featured in the Appendix of the Rivelock's 
book. His paper is designed **to acquaint change agents in educ4tioo 
with the use of power and dissmination functions of educational 
professional aasociationa so that these vight be utilised to effect 
change.** 

K>cros categorises three general groups of professional orgatiiza* 
tlona: (1) geoeral purpose teacher organise t ions, i.e., Maticnal 
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Education Assoclaizion and the American Federation of Teachers: (2) 
administrative and other educational specialty organizations, e.g., 
American Association of School Administrators (AASA), Association for 
Supervision ai}d Curriculum Development (ASCD), National Association of 
Elementary School Principals (NAESP), Department of Audiovisual 
Instruction (MVI), American Educational Research Association (AERA); 
(3) subject area teacher organisations, e.g^t National Couni:::il of 
Teachers of English, National Gouncll of Teacher of Mathematics, 

After categorizing the organizations, Doros dlscusSiBS Implications 
of these organizations for change agents and suggests some tips for 
working with such professional associations. 



